Image and Augmented Reality Based Networks Using Mobile Devices and Intelligent Electronic Glasses

ABSTRACT

A mobile communication system based on digital content including images and video that may be acquired, processed, and displayed using a plurality of mobile device, smartphones, tablet computers, stationary computers, intelligent electronic glasses, smart glasses, headsets, watches, smart devices, vehicles, and servers. Content may be acquired continuously by input and output devices and displayed in a social network. Images may have associated additional properties including nature of voice, audio, data and other information. This content may be displayed and acted upon in an augmented reality or virtual reality system. The imaged base network system may have the ability to learn and form intelligent association between aspects, people and other entities; between images and the associated data relating to both animate and inanimate entities for intelligent image based communication in a network. Acquired content may be processed for predictive analytics. Individuals may be imaged for targeted and personalized advertising.

CROSS REFERENCE TO RELATED PATENT APPLICATIONS

The present application is a continuation of application Ser. No.14/579,497 filed Dec. 22, 2014 (now U.S. Pat. No. 9,380,177), which is acontinuation of application Ser. No. 13/751,049 filed Jan. 26, 2013 (nowU.S. Pat. No. 8,965,460), which is a continuation-in-part of co-pendingapplication Ser. No. 10/769,621, filed Jan. 30, 2004 (now U.S. Pat. No.8,483,754), each of which is incorporated herein by reference in itsentirety.

BACKGROUND OF THE INVENTION

In the prior art the primary methods of communication are primarilyvoice based such as by means of a communication device such as thetelephone, cellular telephone or other mobile devices augmented asneeded by textual methods such as handwriting. In recent times thecommunication methods have expanded to include such digital andelectronic methods as e-mail with the ability to receive files of voice,audio, video and data files as attachments and the means for recoding,playing and or viewing these files. In the prior art these files arediscrete and separate and do not necessarily exist as one composite filethus limiting utility.

However, the primary means of communication in the prior art is notvisual based whereas human beings by nature relate better to image basedcommunication and visual stimuli. Hence, there is a need for a highquality visual web comprising of images and videos. There is a need fora plurality of mobile devices including smartphones and glasses to aidin acquisition and presentation of this information. The ability ofhuman beings to recognize an image and respond to an image may be farsuperior to other cognitive senses and may be preferred by itself and orin combination with other methods such as voice. The communicationsystems of the prior art have a number of limitations makingcommunication between individuals that have a physical limitation suchas a hearing impairment or a language barrier difficult. Consequently,it is desirable to have a means for communicating primarily by means ofimages coupled as desired by the user with one or more other methodsselected by the user, such as voice, audio, text and data and othermethods as deemed appropriate for the desired application. In the priorart the means for interfacing with a mobile device such as cell phonehas certain limitations for data entry being key stroke based, pen basedfor touch screens or voice based. There is a need for image basedcommunication since the integration of image acquisition capabilitieswith a mobile device allow for the sending and receiving of images on amobile device. However, the prior art just enables the viewing of theimages and does not enable the image to be endowed with different typesof related information thus rendering the images of the prior art tohave limited utility and no functionality that could be associated withthe image and or launched by touching an entire image or a subset of animage such as a photo.

Further the means of acquiring images in the prior art remain limited.There is a need for multimodal and multifunction mobile device includingintelligent electronic glasses and discrete image acquisition sensors.

The present disclosure is intended to solve the problem enumerated aboveand other problems. The present disclosure teaches multifunction mobiledevices including smartphones and glasses that allow for computing to bebetter integrated into everyday activities. As an example, glasses wornon the face may allow continuous access to an electronic display. Theseglasses may further allow for continuous capture of images, video, andaudio. These glasses may bridge the physical and virtual worlds andprovide an augmented reality experience.

The present disclosure describes and teaches a novel method forconstructing image network/augmented reality network s for efficient andintelligent communication between one or more mobile devices/intelligentelectronic glasses/headset, stationary devices, servers and individualsusing images as a medium of communication with related device profilesand user profiles. The present disclosure additionally teaches novelmeans for associating the image with one or more attributes andcharacteristics coupled with other forms of communication such as text,voice, data and other methods. The present disclosure in a novel mannerleverages the ability to digitize all types of data inclusive of images,voice, text, data and other information enabling the establishment ofrelationships with the different types of the data components coupledwith the ability to use the mobile device/intelligent electronicglasses/headset by itself and one or more servers in conjunction withthe mobile device/intelligent electronic glasses/headset to deliverunique and novel utility not offered by the prior art.

The image network/augmented reality networks of the present disclosureare constructed enabling secure and trusted communication by means ofencryption and other novel security features. Images by their verynature require the processing and storage of a large amount of digitaldata. Additionally, when an image is coupled with various types of otherdata such as text, voice, and digital data, the resulting combinationrequires significant real time processing and storage. The presentdisclosure teaches a novel method for enabling the real time processingand storage of images by means of the mobile device/intelligentelectronic glasses/headset acting by itself and or in conjunction withother mobile devices/intelligent electronic glasses/headsets, and local,central and or network servers.

The present disclosure additionally teaches the system level means forassociating the image of an animate or inanimate aspect with collateralinformation relating to the aspect acquired by one or more meansinclusive of, image sensors, NFC and RFID tags also known as radiofrequency identification tags to enable intelligent imagenetwork/augmented reality network s that are capable of being integratedinto a larger digital network existing locally or on the Internet.

The present disclosure teaches the system for using the image that isdisplayed on a standard display or the image that is displayed on atouch sensitive display to be associated with various profiles relatingto the image comprising of audio, voice, text, data, function and otherinformation; further providing the means for actuation and control offunctions and applications based on images and or subsets of the imagesbeing displayed.

SUMMARY OF THE INVENTION

This disclosure generally relates to a plurality of multimodal andmultifunction input and output mobile device including intelligentelectronic glasses. It is an attribute of the present disclosure toenable mobile devices, advanced smartphones, cellular telephones, tabletcomputers, smart goggles, intelligent electronic glasses, cameras, smartprojectors, smart watches, smart headgear, smart headphones, smartheadsets, smart necklaces, smart earrings, and other accessories toprovide digital media content acquisition, presentation, andinteraction. These mobile device/intelligent electronic glasses/headsetmay allow for continuous and always-on acquisition of audio, image,video, location, and other content using a plurality of input methodsincluding images sensors. Further, the mobile device/intelligentelectronic glasses/headset may display content on a variety of displaysand surfaces.

It is an aspect of the present disclosure to enable image basedcommunication between mobile device/intelligent electronicglasses/headset, distributed image sensors, stationary devices, andservers by wired or wireless communication means.

The mobile device/intelligent electronic glasses/headset may enabledevice or server control including gesture control, retinal control,facial control, and other user interface activities for a variety ofelectronic devices. In this system, image sensors may be integrated intovarious mobile devices. Image sensors may also be coupled to a varietyof traditional non-electronic devices. As an example, a camera may beintegrated into a pair of sunglasses and a display may be affixed to thelens or area proximate to the lens of the glasses. Communication betweenthe mobile devices/intelligent electronic glasses/headset and otherdevices including Internet or network servers may be completed usingwireless transmit and receive radios integrated into the devices.

It is an embodiment in the system to have intelligent electronic glassesor headsets configured to be worn on the body. These intelligentelectronic glasses or headsets may be enabled with the full or partialfunctions previously resident on a smartphone or stationary electronicdevice. The intelligent electronic glasses may leverage the processingcapability of a smartphone or a local or network server and continuouslyacquire, transmit, and receive digital content.

The intelligent electronic glasses or headset may comprise a full set orsubset of these components including: processor; multicore processor;graphics processor; display; high definition display; LCD, LED, see thruLED, see thru mirror display, see thru LCD/LED mirror display or otherdisplays; dual displays for each eye; keyboard; projected keyboard; onscreen keyboard; programmable buttons; microphone; noise isolation ornoise cancellation; speakerphone; in-ear speaker; digital still camera;digital video camera; front facing camera; back facing camera; sidefacing camera; eye tracking camera; high definition (HD, 720p, 1020p)camera; light/flash; laser; projector; infrared or proximity sensor;vibration device; LEDs; light sensor; accelerometer; gyroscope; x-y-zpositioning; GPS; compass including solid state compass; memory such asflash memory; buffer memory; power sources; battery; rechargeablebattery; multiple data and video input and output ports such as audio,ethernet, USB, firewire, 1394, VGA, or HDMI; wireless transmit andreceive units such as Bluetooth, WiFi (802.11a,b,c,n,x), Cellular (GSM,Edge, CDMA, others); transmission protocol software such as TCP/IP; oneor more antennas including antennas fitted into the frame of theglasses; operating system; software such as image recognition software;access to an software application store; smartphone/tablet, server,cloud, or desktop synchronization software; audio, pictures, and videostreaming software; Internet configuration; UI command and control suchas gesture control, retinal control, face and expression control; lens;fingerprint resistant lens; replaceable lens; see thru lens; filters;audio and video playback; and various other components. Components maybe integrated into ASICs, integrated housing, separated components, orswappable components.

The mobile device may comprise a full set or subset of these componentsincluding: processor; multicore processor; graphics processor; display;high definition display; LCD, LED, see thru LED, see thru mirrordisplay, see thru LCD/LED mirror display or other displays; dualdisplays for each eye; keyboard; projected keyboard; on screen keyboard;programmable buttons; microphone; noise isolation or noise cancellation;speakerphone; in-ear speaker; digital still camera; digital videocamera; front facing camera; back facing camera; side facing camera; eyetracking camera; high definition (HD, 720p, 1020p) camera; light/flash;laser; projector; infrared or proximity sensor; vibration device; LEDs;light sensor; accelerometer; gyroscope; x-y-z positioning; GPS; compassincluding solid state compass; memory such as flash memory; buffermemory; power sources; battery; rechargeable battery; multiple data andvideo input and output ports such as audio, Ethernet, USB, firewire,1394, VGA, or HDMI; wireless transmit and receive units such asBluetooth, WiFi (802.11x), Cellular (GSM, Edge, CDMA, others);transmission protocol software such as TCP/IP; one or more antennasincluding antennas fitted into the frame of the glasses; operatingsystem; software such as image recognition software; access to ansoftware application store; smartphone/tablet, server, cloud, or desktopsynchronization software; audio, pictures, and video streaming software;Internet configuration; UI command and control such as gesture control,retinal control, face and expression control; lens; fingerprintresistant lens; replaceable lens; see thru lens; filters; audio andvideo playback; and various other components. Components may be housedin various integrated ASICs, integrated housing; separated components,or swappable components.

A watch may comprise a full set or subset of these components including:processor; multicore processor; graphics processor; display; highdefinition display; LCD, LED, see thru LED, see thru mirror display, seethru LCD/LED mirror display or other displays; dual displays for eacheye; keyboard; projected keyboard; on screen keyboard; programmablebuttons; microphone; noise isolation or noise cancellation;speakerphone; in-ear speaker; digital still camera; digital videocamera; front facing camera; back facing camera; side facing camera; eyetracking camera; high definition (HD, 720p, 1020p) camera; light/flash;laser; projector; infrared or proximity sensor; vibration device; LEDs;light sensor; accelerometer; gyroscope; x-y-z positioning; GPS; compassincluding solid state compass; memory such as flash memory; buffermemory; power sources; battery; rechargeable battery; multiple data andvideo input and output ports such as audio, ethernet, USB, firewire,1394, VGA, or HDMI; wireless transmit and receive units such asBluetooth, WiFi (802.11x), Cellular (GSM, Edge, CDMA, others);transmission protocol software such as TCP/IP; one or more antennasincluding antennas fitted into the frame of the glasses; operatingsystem; software such as image recognition software; access to ansoftware application store; smartphone/tablet, server, cloud, or desktopsynchronization software; audio, pictures, and video streaming software;Internet configuration; UI command and control such as gesture control,retinal control, face and expression control; audio and video playback;and various other components. Components may be housed in variousintegrated ASICs, integrated housing; separated components, or swappablecomponents. The watch may function as a second screen or “n-th” screendevice for another display such as a smartphone or television.

The cellular telephone, glasses, watch, and other electronic devices maycommunicate with each other and with local or network servers.

The glasses can be used to take a single picture, a series of pictures,or full motion video through the use of a camera that is mounted on thehousing of the glasses frame or integrated into the lens. In theintegrated camera model, the camera electronics may be integrated intothe frame of the glasses and the lens of the glasses is used as the lensfor the camera. Image and video data can be wirelessly uploaded to aremote server or alternatively stored locally on the glasses.

In another aspect of the invention, the glasses may project text on to aphysical object.

In another aspect, the intelligent electronic glasses may record anindividual touching of an object and classify the object in a data andthe object is connected to various meta-data including location, time ofday, temperature, proximity to people and other factors.

In another aspect, the intelligent electronic glasses may present in afirst lens an advertising or product purchase placement that is viewedin the second lens.

In another aspect, one lens of the intelligent electronic glasses maydisplay all of the prior history associated with an object, such as howmany times that object was touched, whether the product is underwarranty or not, what the current price of the product is on a usedmarket, what the price of the product.

In another aspect, the user can access an inventory database consistingof all objects in the room or loaned out to a third party. Thisinformation may be displayed on the mobile device including intelligentelectronic glasses or watch.

In another aspect, a user can trace whether an object is broken basedupon how many times an object was used by that member. As an example, anolder child may blame this on the younger child if he is accused ofbreaking something. A camera may record usage of a device, store thehistory of this usage, analyze the usage, and present recommended viewperiods of the potential breaking incident.

In another aspect, one lens can browse the internet and the other lensof the glass can present image, video, or text.

In another aspect, the glasses can change from one tint to another todecrease exposure to the eye.

In another aspect, the glasses have a wireless transmit and receiveradio built-into the device for continuous and real-time streaming to alocal or network server.

In another aspect, the wire frame may be configured as one or moreantennas for one or more wireless radios.

In another aspect, the glasses record conversations and auto playbackfor repeating conversations and agreements of conversations. This may beuseful for auditing of contracts, agreements, or events. Alternatively,it may be useful in recording a person's life events.

In another aspect, dual cameras may be used simultaneously. For example,one camera may take a picture and the other camera may acquire videowhile a microphone captures audio. Alternatively, multiple cameras maybe used simultaneously to provide a 360 degree experience.Alternatively, one camera may be a 3D camera.

In another aspect, the camera may work in conjunction with the specificdisplays on the mobile device, glasses, or watch. For example, a usermay select to activate a rear camera so that it is displayed in the leftor right lens.

In another aspect, the camera can provide magnification of content byallowing for a zoom function. This may be useful in experiments andthereby obviate the need for a microscope. It may be useful in thedriving context to identify road hazards. It may be useful outside toidentify stars, clouds, and other items.

In another aspect, the zoom function is done through interpolationthereby providing optical and digital zoom capabilities.

In another aspect, glasses include a micro-projector so that they candisplay content on to a hand, wall, pavement.

In another aspect, the projected content may be obtained in real timefrom another set of glasses, video, internet site, or stored media on aserver.

In another aspect, a first camera on the glasses captures movement andthe second glasses captures movement so as to provide a touch likeinterface without a surface.

Alternatively, a sensor may send a light pulse to gauge the distancebetween the hand and the projected image so as to identify where contactwas made on the projected image.

Alternatively, a sound may sound may be used to detect distance from thehand to the glasses or may be used to track the send and receive of thesignal.

Alternatively, a laser may be used to track and identify gestures.

Alternatively, the glasses may leverage the processing power resident ona second device including a cellular phone, watch or other mobiledevice.

In another aspect, content acquired from the glasses may be displayed ona TV, watch, or mobile phone.

In another aspect, the glasses may include a flash for pictures or alight and may be integrated into the device or be an attachment.

In another aspect, the resolution of the images may be modified usingvarious lenses varying distance between the eye and the lens or otherapproaches.

Alternatively, a mobile device may be used and may display on the screenimages acquired from a separate camera such as those on a pair ofglasses where the images are annotated with content acquired from aninternet server or local object. In turn each object may broadcast usingRFID or other means information about itself to glasses, phones, server,or other devices. This RFID may be a label and can affix it to otherdevices.

Alternatively, the label may be a bar code or other image. This labelmay be a physical or virtual label and may include a barcode or otheridentifier. A table stored on a server or other device may map the labelto data about the object. An owner, gifter, seller, or other person orsystem may create a data table including object location and other metadata, including purchase data, purchase price, ownership, useful life,willingness to sell object at an offer price. The data set may also pullin real time data including current price used on various exchanges.These objects may be automatically placed on an internet auction forimmediate sale. A user may set an aspiration price including for familyheirlooms. This obviates the need for the owner to manually post theseitems on an online exchange.

A user may then use their interface component such as glasses or mobilephone to assess the value of all objects within a home or environment.

The camera mounted on the glasses, smartphone, vacuum cleaner, or otherrobot may automatically scan home environment. For example, a roboticvacuum cleaner of a hotel may constantly scan a room to determinewhether any objects are missing. This map of objects and paths may alsobe posted to an Internet server or database.

In another embodiment, a user may move a virtual object in a display andhave the object move in the physical world by a robot. For example, achef may move virtual images of objects such as a tomato and a robot maymove the tomato in the physical world. This may enable remote cookingfor elderly people or friends.

In another embodiment, it may be that one eye or multiple eyes may beimpaired. The display may alter resolution, magnification, and otherfactors by lens to compensate for physical deficiencies.

In another aspect, the mobile device/intelligent electronicglasses/headset/watch may be able to convert spoken audio to text inreal time and post the information on one or more displays. As anexample, a conversation may appear in the left lens of the glasses as aperson is speaking. In the right lens, a set of conversation topics orInternet search terms related to the spoken content may appear.

In another aspect, distance may be measured by modifying one lens andanother lens to focus on different focal areas.

In another aspect, a camera at the top of the glasses may zoom in on ahands and a projector may display an image of a keyboard so as to allowtyping on the air. A laser may be used to track the gestures.Alternatively an inward facing camera may be used to track eye movementto understand the focus areas of the individual and map these focusareas to the gestures or control activities.

In another aspect, eye-tracking may be enabled on a camera focused on anindividuals eyes. This camera may be integrated into the intelligentelectronic glasses. Alternatively, it may be a second camera on a mobilephone. This may be used to measure advertising effectiveness such aswhen an individual watches television or when an individual walks down astreet and sees billboards.

Alternatively, eye tracking may be used for fatigued drivers and theymay measure pupil dilation, eye strain redness and other factors toassess exhaustion and the potential of falling asleep at the wheel.Alternatively, the glasses may measure physiological problems formedical diagnosis such as glaucoma and cataracts.

In another aspect, the glasses may be used for gaming includingscavenger hunts or other activities.

In yet another aspect, the mobile device/intelligent electronicglasses/headset may be used to control actions in a different area. Asan example, a person may be at the office and wish to control appliancesat home. The display may show the inside of the person's house and allowthe individual to make gestures such as turn off and on lights in thevirtual reality view. These actions and commands may be recorded bymobile device/intelligent electronic glasses/headset, sent to a server,and in turn sent to a home server or the home device to implement theaction. This may allow full home automation and control using the mobiledevices/intelligent electronic glasses/headset from remote locations.

The glasses may be part of a network and allow a first individual totake control of another person's glasses. Glasses may be identified byIP address or another unique numeric or alphanumeric ID. In thisinstance, a user or system may login to the glasses device, updateconfigurations and software, and change the camera acquisitionactivities and display. As an example, an individual wearing glassesthat enters a retail store, may not find a retail store employee to helpwith a purchase. The store may allow for virtual retail assistants oravatars that can be activated on the display of the glasses or externaldisplay. This may allow for automated sales without the need for people.Other payment mechanisms including RFID, NFC, and cloud based storage ofcredit card information may be used to allow for immediate purchases ofproducts.

In yet another embodiment, digital content may be recorded, streamed, orviewed on a time lapsed basis.

In yet another embodiment, objects and items may be automatically taggedwith location, context, purchase, and other related data. For examplethis may aid a person in identifying where the person left their keys.Information about the last known location of the keys may beautomatically recorded by the camera or tagged by the device. Thiscontent may be indexed and searched. Alternatively, it may allow aperson to run a search query such as identifying all the items in housethat were touched.

In yet another embodiment, various statistical, behavioral, andpredictive models may be built based on the large or big data obtainedfrom the input devices. As an example, a prediction function may suggestto a concerned family member the likely activities of a relative.Alternatively, a prediction may be made by a server on which types ofpeople tend to look at certain objects and which types tend to ignorecertain objects. This could be helpful for a real-estate ad-network.

In yet another object, the mobile device/intelligent electronicglasses/headsets and distributed camera arrays may be used as a securitysystem. Multiple people may opt their devices into a centralized sharingserver that may be searched and used for various predictions. This maybe helpful in identifying erratic behavior.

In yet another embodiment, various micro-expressions and emotions may bedetected by the facial expressions of a person.

In yet another embodiment, a camera may perform lip reading tounderstand spoken words when audio is not available. This may enable aperson wearing intelligent electronic glasses to read the lips of aperson far across a room.

Example Variants of Glasses

In yet another embodiment, the glasses may be manufactured with variousversions that account for design, cost, weight, brand, and otherfactors. One variant of the glasses may include a full helmet or goggleswhich provide a housing to encompass additional processors, memory,wireless radios, antennas, cameras, GPS, multiple displays, microphone,speakerphone, and battery. Another version of the glasses may onlyrequire a low-power processor, battery, memory, camera, Bluetooth, andWiFi radio without a display. Yet another version may be sold with adisplay. Other versions may be sold with various protocols.

In another embodiment, multiple displays may be provided targeted atboth the left and the right eye.

In yet another embodiment, the lens may be split into a multiple areas,where one area may comprise an display, such as an LCD display, and asecond area may be clear to provide traditional viewing. In one instancethis may be a bifocal lens where one area of the lens is an electronicdisplay and another area of the lens is a traditional non-electroniclens.

In another embodiment, the device may include an over the ear clip,microphone, in-ear speaker, battery, and display configured to wraparound the forehead and positioned in front of the left or right eye.This item may include a rotatable hinge located above the over the earcomponent to allow for the display in front of the eye to be moved up ordown. It is anticipated that the electronics including sensors andmemory will continue to improve in efficiency and capabilities so as toincrease the features offered in a smaller lighter package.

In yet another aspect, the functions of the glasses may also integratedinto earnings, headsets and necklaces. These devices may be configuredwith one or more antennas, one or more wireless or wired transmit andreceive radios, one or more processors, one or more buttons, one or morecameras, one or more lasers, one or more microphones, one or morespeakerphones, one or more touch or non-touch screen displays, aminiaturized projector, battery, and power input and output.

In another variation of the glasses, the glasses may be configured withmultiple cameras including a front facing camera and a back-facingcamera.

In another variation of the system is for the glasses to be configuredwith replaceable frames and lenses. It is another variation for thelenses to be configured with varying levels of polarization. Thepolarized may enable the frames to reduce glare. These polarized lensesmay have a variety of filters associated with them. The filters may beintegrated into the lens. Alternatively, the frames may be equipped withseveral lenses that may be attached to the device simultaneously. A lensmay be moved from an active position and rotated 90 degrees up to aninactive position. Alternatively, a lens may be configured with multiplefilters.

In yet another embodiment, a contact lens may be configured into anelectronic contact lens enabled with a display, transmit and receivecomponent, antenna, and micro battery. The battery may be charged or thelens transmission may be powered by natural fluid movement in the eye orby blinking the eye.

In another variation of the glasses, the polarization may be modified byphysical replacement of the lens. The glasses may provide an easy pop-inand pop out of the lenses. Alternatively the frame may also be easilyreplaceable, where the side frames of the glasses may be affixed to thecenter frame of the glasses using screws or clips.

In another variation of the glasses, the polarization may be modified bya physical dial on the glasses. Alternatively, the polarization may bemodified automatically using a light sensor integrated into the glasses,a CT/MD, a watch, or other proximate or remote device.

In another variation of the glasses, the polarization may be modified bya cellular telephone or mobile device. An application configured to runon the cellular telephone or mobile device may present various settingsto the control the glasses. The application may provide variousconfiguration settings for a user to manage their glasses. As anexample, the application may provide a calibration setting where theCT/MD, glasses, watch, or other device captures the ambient lightincluding wavelengths, and appropriate determines a filter to apply tothe glasses.

In yet another embodiment of the lenses, the may be configured withanti-reflective lens or progressive lens and other glare reductionmeans.

In yet another embodiment, the lens may be include prescription lens orsunglass lens.

In yet another embodiment, the lens may be configured with a wide fieldof view.

In yet another embodiment, reflected light may be removed whendisplayed.

Example Glasses for Physical Activities and Sports

It is another aspect, the system may allow for a user to be able todefine the activity that is currently being performed and match thefilter on the glasses to the activity. As an example, an individual thatis playing tennis may desire for the filter to provide more clarity on ayellow tennis ball and the white markings on the court.

In yet another variation the mobile device/intelligent electronicglasses/headset may be enabled with training specific software. A laserconfigured on the housing of the glasses, headband, necklace or otherexternal device may be used to assess the speed of objects or people. Alaser on the glasses may target a tennis ball. A camera may image thetennis ball. A specialized miniaturized radio transmitter and receiversuch as a radar gun including various radar forms could be used todetermine the speed of the ball by transmitting a signal focused on theobject, measuring the return signal, and calculating the frequency ofthe signal. The data captured associated with the device may beprocessed in real time by a local device or a remote server to predictthe movement of the object. The predicted position of the object may beused to allow an individual more time to react to the object. Forexample, the tennis ball may be shown in glasses in a virtualrepresentation as being closer to the individual than in the physicalworld so that a user may react more quickly to the ball if the user isshown to be responding slow to the tennis balls. Alternatively, theperception may be a calibration setting that can be configured on theglasses, a CT/MD, or a server. The speed of the ball may be displayed onthe glasses, a CT/MD, posted to an Internet web page, or stored on aserver.

In yet another embodiment, the mobile device/intelligent electronicglasses/headset may also be used in other sports such as golf. In thisembodiment, a camera may image the golf ball, stroke, and distance ofthe ball from the tee.

Alternatively, the mobile device/intelligent electronic glasses/headsetmay be used in a football context where the ball may be measured for theappropriate spin, speed, and distance. In yet another embodiment, abiker may use the mobile device/intelligent electronic glasses/headsetwhile biking on city streets or through nature. In this embodiment, theglasses may identify cars around the biker. The mobiledevice/intelligent electronic glasses/headset may further provide aspeedometer, acceleration, and various other statistics about themovement of the individual.

Example Transportation and Glasses in Moving Vehicles

In yet another variation, the intelligent electronic glasses may be usedin a car. The glasses may image the cars in front, on the side and/orbehind the vehicle that an individual is presently in. The glasses maysend the data to the CT/MD for further processing, a watch, wirelessprocessor enabled necklace, server located in the car, or a remoteserver. The glasses may acquire the images of the vehicles in closeproximity to the current vehicle, measure the speed of the neighboringvehicles, and track the trajectory of the vehicle. If a vehicle ismoving closer than predicted by the system to the present user, theglasses may present a warning indicator on the screen of the classes; aspoken audio through the speakerphone of the CT/MD or car; a vibrationof the phone or the glasses. A camera may further be integrated a carvehicle on the top and/or sides of the car. These images may further besent to the displays in the car, on the mobile device, or theintelligent electronic glasses/headset.

The glasses when used by a driver may also be a tool to give feedback onthe driving experience, potential for road hazards or incorrect driverbehavior. The glasses may image the road ahead of the vehicle. Theimages may highlight potholes, sharp turns, obstructions in the roadway,animals, and other objects. The glasses may send the images acquiredusing the camera to the CT/MD or server for further processing or theglasses may optionally be configured with a higher end processor toperform some level of processing. The CT/MD may assess the danger of theobject such as a pothole and suggest a corrective action to the driver.The corrective action may be a synthesized spoken audio commandindicating the action to take or it may be a visual message that appearson the lens of the glasses or projected from the glasses onto thewindshield of the car.

In yet another embodiment, the mobile device/intelligent electronicglasses/headset may be enabled with thermal imaging capabilities or withradiation scanner which identifies radiation such as terahertzradiation. This may be used by TSA personnel to scan a person in anairport or by local police to scan individuals in a crowd for illicitobjects.

Example Electronic Earnings, Necklace, and Shoes

In another embodiment, a variety of other items including earrings,necklaces, and shoes may be enabled with electronic components toprovide I/O and control. Alternatively, a camera and microphone may beclipped onto a shirt or object to capture images and video.

In another variation, a see thru LED, LCD, or other type of mirror mayfunction as a display.

Example Location Positioning Using Networks and Cameras

In yet another variation, a camera network may continuously capture dataabout people, objects, and environmental factors. As an example, alocation of an individual may be obtained by a reading from image andfacial recognition of a picture obtained from a camera.

In yet another variation, the song and music information may be shown inthe display. A song played in a coffee shop may be recognized and themeta information about the song may be shown in the display of theglasses or mobile device.

In yet another embodiment, the mobile device/intelligent electronicglasses/headsets may be used in academic or science environment. Thismay allow a student to use the camera as a microscope or telescope.

In yet another embodiment, the mobile device/intelligent electronicglasses/headsets may allow for complete video acquisition of an eventand then subsequent replay of that event. For example, a person with thecamera may record a full 360 immersive show and then allow the show tobe replayed on another display in real time or time shifted. As anexample, a music concert may be recorded using the mobiledevice/intelligent electronic glasses and then replayed later.Alternatively, meta data about the songs and the concert may be added inreal time. Content may be magnified or zoomed in.

In yet another embodiment, a person wearing the mobiledevice/intelligent electronic glasses/headset may have a roomautomatically imaged. In this situation, the people may be recognizedeither by the spoke audio using voice recognition or facial recognition.A list of all the people and social data about the people may bedisplayed on a screen or the lens of the glasses. The system may furthersuggest conversation topics for each person in the room.

In yet another embodiment, a person's activities may be automaticallyposted to a public or private web pages, social network, data storageserver, or synchronized across devices.

In yet another embodiment, the mobile device/intelligent electronicglasses/headset may be used to scan and ISBN, QR, barcode, or recognizean image of a product based on the design or label and provide reviews,ratings, comparison shopping data, or other information about therecognized product.

In yet another embodiment, an advertiser may be able to bid on all theadvertisements associated with a specific person's view in theintelligent electronic glasses.

In yet another embodiment, a person wearing the glasses may patch inavatars, images, and objects into the environment. As an example, absentfamily member may be patched in for dinner. The person may be connectedto an audio of that individual or pre-recorded messages from theindividual. These pre-recorded messages may have been obtained from adatabase or recorded audio.

In a related embodiment, a camera may scan a person's iris for retinaldata and perform a match between the retinal scan and a stored image ina server. The match can identify the location of a user as beingproximate to the image sensor that acquired the iris shot.Alternatively, an image or video or related content may be projected onto the retina or displayed in very close proximity to the retina.

It is an aspect of the present disclosure to enable the construction andimplementation of virtual image based networks.

It is an aspect of the present disclosure to enable images to beassociated inherently or by specific selection with one or more othermethods of communication such as text, voice, audio, data and otherforms.

It is an aspect of the present disclosure to enable imagenetwork/augmented reality network s to be composed of a series of imagesto form a video with the explicit intention that the definition and theuse of the term image network/augmented reality network s is inclusiveof various types of photos, graphics, still images and video renderedone at a time or sequentially and continuously.

It is an aspect of the present disclosure to define the acquisitionmeans of the image to include by means of light in various wave lengths,inclusive of methods such as night vision spectra, night vision goggles,and other electro magnetic means.

It is an aspect of the present disclosure to enable the image by itselfto be processed as digital data and combined selectively or inherentlywith other forms of digital data such as text, voice, audio, data andother forms to form one composite resultant entity for the desiredutility in an image network/augmented reality network.

It is an aspect of the present disclosure to encode, decode, compress,de compress the digitized image data by itself with various methods forencryption, decryption, compression and decompression that are bestsuited for each type of images or subset of an image to enable secureand efficient communication.

It is an aspect of the present disclosure to encode and decode thedigitized text, voice, audio and other data by themselves and or incombination with various methods for encryption, decryption, compressionand decompression that are best suited for each form and type of data toenable secure and efficient communication.

It is an aspect of the present disclosure to enable a unique encryptionand compression key to be associated with the image and the other dataassociated with the specific image, sub set of the image or the specificimage network/augmented reality network that the image is part of bymeans of the mobile device/intelligent electronic glasses/headset actingby itself and or in conjunction with the central server acting as atrusted escrow server.

It is an aspect of the present disclosure to enable a unique decryptionand decompression key to be associated with the image and the other dataassociated with the specific image, sub set of the image or the specificimage network/augmented reality network that the image is part of bymeans of the mobile device/intelligent electronic glasses/headset actingby itself and or in conjunction with the central server acting as atrusted escrow server.

It is an aspect of the present disclosure to enable a unique encryption,decryption, compression and decompression keys to be associated with theimage and the other data associated with the specific image, sub set ofthe image or the specific image network/augmented reality network thatthe image is part of by means of one or more mobile device/intelligentelectronic glasses/headsets directly exchanging the keys for a specificimage based communication with said keys being enabled for a specificpurpose, at a specific time or for a specific duration.

Yet another aspect of the present disclosure teaches the system levelmeans for associating the image of an animate or inanimate object withcollateral information relating to the object acquired by one or morewired or wireless means inclusive of, image sensors and RF ID tags alsoknown as radio frequency identification tags to enable intelligent imagenetwork/augmented reality network s that are capable of being integratedinto a larger digital network existing locally or on the Internet.

Another aspect of the disclosure is to enable an image to be dynamicallyconstructed and or deconstructed as a virtual digital image entity bysoftware means of the image itself and or in association with otherrelated parameters such as voice, text, data and other relatedinformation.

Another aspect of the disclosure is to enable a digital image entity tobe dynamically constructed and deconstructed such that the digital imageentity comes into existence at a specified time, exists for a desiredduration of time, and ceases to exist at a set time, with the additionalfeatures of being launched for a specific purpose.

Another aspect of the disclosure is to enable a digital image entity tobe dynamically constructed and deconstructed such that the digital imageentity is transformed by one or more algorithms to another digital imageentity based on factors such as the security levels, the physicalnetworks being traversed, the specific mobile device/intelligentelectronic glasses/headset being used and the individuals using thespecific mobile device/intelligent electronic glasses/headset.

Another aspect of the disclosure is to enable a digital image entity tobe characterized by form and function wherein the image entity conveysdescriptive attributes and or executable functions resulting in thedesired actions being actuated, wherein such actions specifically relateto the entire image entity and or sub image entities comprising of theentire image entity.

Another aspect of the disclosure is to enable a digital image entity tobe characterized by form and function wherein the image entity consistsof executable functions which may be actuated by pen based touch, fingerbased touch, voice, audio, sound, speech, light or other pointer meansactuation methods by wired or wireless communication means to deliverthe desired output such as audio, video and text, voice and speech inone or more languages.

Another aspect of the disclosure is to enable a digital image entity oran entire image network/augmented reality network to be propagatedacross a network of mobile device/intelligent electronicglasses/headsets, stationary devices and servers to one or more selectedmobile device/intelligent electronic glasses/headsets at the desiredtime and in the desired sequence, wherein such propagation of the imageentity or the image network/augmented reality network causes the imagenetwork/augmented reality network existing on the mobiledevice/intelligent electronic glasses/headset prior to the propagationto be updated instantaneously or at the desired time.

Another aspect of the disclosure is to enable a digital image entity oran entire image network/augmented reality network to be propagatedacross a network of users based on the profiles of the user, at thedesired time and in the desired sequence to cause one or more socialnetworks, professional networks, personal networks, family networks, orother networks of the user to be updated.

Another aspect of the disclosure is to enable a digital image entity, asubset of an image entity or an entire network of images to bepropagated across a network of intelligent devices and display devicessuch a computer, TV, monitor or other devices based on the profiles ofthe mobile device/intelligent electronic glasses/headsets and or theuser, at the desired time and in the desired sequence for the desiredutility.

Another aspect is to enable a display for a TV or monitor or a displayfor mobile device/intelligent electronic glasses/headset to beconfigured for high definition quality by enabling images to be viewedas image entities and for the entire screen or portion of the screen tobe modified and or controlled in a granular manner.

Another embodiment is to enable the screen image as an imagenetwork/augmented reality network that is as a network or image entitiesfor the provision of better quality multimedia experience.

Another embodiment is to enable control, actuation of functions bytouching a specific portions of the screen or subsets of the screen ortouching a surface or creating gestures in the air to launch one or moreapplications and or control functions and or actuation functions relatedto other intelligent devices. It is an aspect of this disclosure, thatvarious electronic and mobile devices including smartphones, cellulartelephones, tablet computers, watches, necklaces, earrings, shoes,headsets, headbands and other devices may be enabled with one ore morecomponents such as cameras and displays to allow for input, output,processing, and transmit and receive. Further, the devices maycommunicate with one another and state their capabilities includingconnection speed and processing power.

Other aspects, features and advantages of the present disclosure willbecome apparent from the following detailed description when taken inconjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

The accompanying drawings, being incorporated in and forming a part ofthis specification, illustrate embodiments of the disclosure and,together with the description, serve to explain the principles of thepresent disclosure:

FIG. 1 shows a mobile device/intelligent electronic glasses/headsetcomprising of a plurality of device profiles and user profiles with thecapability to acquire images and related information, capability torecognize the images and compare the images, and the capability to send,receive, process and store by wired or wireless communication means. Theimage further being described as a virtual image entity by softwaremeans wherein the image entity comprises of an image profile thatassociates the image with collateral information such as audio, voice,text, speech, location, time data, handwriting, encryption/decryption,compression/decompression, description, behavior, function andrelationships to other images/objects to form an image profile.

FIG. 2 shows a network of image entities that are virtually connected toeach other by software means. Each of the images entities are describedas having a relationship to the other enabling an intelligent imagenetwork/augmented reality network to be constructed.

FIG. 3 shows an enlarged image network/augmented reality networkcomprising of one or more image entities connected together defined by avirtual relationship. Each image entity each further comprises of one ormore sub image entities that are connected to a specific image entity bytheir own sub relationships. This figure shows a hierarchicalrelationship of an image entity to sub image entities, showing an imagenetwork/augmented reality network within an image network/augmentedreality network.

FIG. 4 shows an even more extended and enlarged image network/augmentedreality network forming a super image network/augmented reality network,comprising of one or more super image entities being connected togetherdefined by a virtual relationship between the super images. Each superimage entity further comprises of one or more image entities that forman image network/augmented reality network wherein each imagenetwork/augmented reality network comprises of sub image entitiesforming a sub image network/augmented reality network.

FIG. 5 shows a mobile phone device/intelligent electronicglasses/headset configured with image acquisition capabilities such asby means of a built in or external camera, means for wired or wirelesscommunication by transmit/receive functions, means for display, saiddisplay being touch screen or non touch screen enabled. The mobiledevice/intelligent electronic glasses/headset is part of a physicalnetwork formed by an image switch/router, servers, intelligent devicesand sensors having the ability to communicate with a people network, adevice network, an object network, and an image network/augmentedreality network.

FIG. 6 shows a detailed view of an image switch/router wherein the imageswitch/router is capable of taking inputs of an image entity andoutputting same or a transformed image entity for the construction ofand communication with different nodes in an image network/augmentedreality network.

FIG. 7 shows a virtual object network described in software comprisingof one or more objects wherein each object has a defined relationship toanother. Additionally, each object is related to one or moresub-objects.

FIG. 8 shows a virtual super object network described in softwarecomprising of a super object that comprises of one or more other butrelated objects.

FIG. 9 shows an object entity that is defined as an object with anassociated object profile. The figure further shows the 3 dimensionalexternal view of the object, with images being acquired from one or morespherical angles wherein an image entity is generated for each view.

FIG. 10 shows the view of an object from an internal to the objectperspective. The image sensor located internal to the object generatesone or more image entities to form an image network/augmented realitynetwork that establishes a relationship that best describes the object.

FIG. 11 shows a network composed of mobile device/intelligent electronicglasses/headsets/users, local, central, network and escrow servers,image switch router, a controller that enables actuation andfunctionality by a plurality of interface methods, and a touch screen ornon touch screen display that comprises of a tool bar. Various imageentities are enabled for display.

FIG. 12. shows an intelligent electronic glasses and smartphoneconfigured with a camera, laser, and projector in communication with asmartphone. The glasses may project a keyboard onto a hand or surfaceand allow a user to compose a message on a non-touch surface.

FIG. 13. shows a watch and cellular telephone projecting a keyboard on ahand of an individual. An individual may make contact with the skin orproximate area of the hand to initiate a call.

FIG. 14. shows a hand of an individual as viewed through the display ofan intelligent electronic glasses or headset. The keyboard may be shownin the display and not actually projected onto the hand, therebyenabling a virtual projection onto the hand in which the keyboard asshown is super-imposed onto the image of hand and viewed through adisplay. The interaction with this keyboard may be using a finger orpen. The finger or pen movement may be tracked by a camera or laserhoused on the mobile device/intelligent electronic glasses/headset. Thismay enable a private interaction on the hand since the keyboard is onlyviewable on the display and not on the physical hand.

FIG. 15 shows the intelligent electronic glasses viewing a virtualkeyboard, menu, or other menu command action in a display area of theglasses.

FIG. 16 shows a hand interacting with an intelligent table, where thetable has a touch sensitive display. The movement of the hand may betracked by a camera or laser. Alternatively a person in a room may betracked using the camera and engaged with games. As an example, thesystem may allow for a baby to be monitored by the camera and interactedwith a remote person such as a parent, baby sitter, or teacher using alocal projector. The intelligent table may be used for interacting withpeople in the room. A projector in the conference room may furthercreate a hologram of a person or object.

FIG. 17 shows the display of the glasses with Internet and web basedcontent. The content obtained and displayed is related to the audioobtained from a microphone. A text message may be sent to a mobiledevice or intelligent electronic glasses or headset.

FIG. 18 shows the rear view of the glasses where the display isintegrated into the lens. The content showed in the left lens includesshopping data about an ice cream product. The actions that a person doesmay be linked to a game and allow for badges, rewards, loyalty points,and coupons. As an example, a person that looks at an ice cream conemultiple instances may then be offered a coupon for 10% off to acompeting ice cream shop located nearby. The augmented reality systemmay be linked to a virtual scavenger hunt in which brands advertise andreward individuals for competing tasks including trying on physical orvirtual goods.

FIG. 19 shows content obtained from the intelligent electronic glassesbeing sent to a first television for display on the television. Theglasses camera may further capture content from the television andstream the content to a remote person. This allows a remote person to bepatched into the viewing experience.

FIG. 20 shows an intelligent electronic glasses with a camera where thecamera captures an image of a house, processes the image using asmartphone. The information may be displayed on the smartphone.

FIG. 21 shows an intelligent electronic glasses obtaining an image of ahouse, send the image data to a CT/MD, and the CT/MD further displayingthis information on the display of the CT/MD. The glasses may also beused for night vision or thermal vision.

FIG. 22 allows for an intelligent electronic device used in amulti-party conferencing system. Person 1 has an intelligent electronicdevice with a camera that obtains video and images of two other persons.This content is then streamed to a remote person 4 which can then adviseand participate in the conference. This may allow a local or remoteperson to look at an environment from the vantage point of anotherperson. This may be useful for a negotiation. If multiple image/videocapture devices are used, a person can request to participate in anexperience or view a recorded experience (including a live actionconference, theater or movie experience) from the vantage point ofanother person. A remote person may log-in to the view of anotherperson's glasses.

FIG. 23 shows a set of participants in a recording environment in whichmultiple people are wearing intelligent glasses. All the participantsare viewable in one screen on the lens of a glasses. Alternatively, aperson viewing the experience at a later time may switch vantage points.

FIG. 24 shows a description of virtual notes being associated with adevice. Items may be highlighted, bold, changed in color in a virtualcontext. These notes and environments may be saved by a user andviewable by anyone in the geofenced area or all users. This may allowfor a personal diary of continuous data to be created. A series ofquestions and answers may be created to help facilitate structured andunstructured data. Notes may also be reminders that are generated basedon predictive analytics of a person's behavior. The consumption of foodmay be tracked and the calories consumed may be calculated. A camera mayimage food as a chef is preparing or while a person is consuming thefood. Food imagery may be processed for image recognition andnutritional value using a local or network server. A report onnutritional value of food consumed and recommendations on behavioralimprovements may be created and delivered daily. Fitness information mayalso be gathered from movement data. An individual may view the objectin the display of a smartphone or table computer or the display of theintelligent electronic glasses or the headset display.

FIG. 25 shows the glasses being used outside to focus and recognizedistant and proximate objects. This information may be displayed on thecellular telephone and mobile devices. The mobile devices/intelligentelectronic glasses/headsets may be used in other outdoor contexts andunderwater. As an example, underwater the glasses may be configured asunderwater goggles and image fish and plants around the person.

FIG. 26 shows image capture of objects and the transformation of thoseobjects in the display. The images obtained may be processed and changesmay be enacted such that they are displayed virtually different thanthey are physically. As an example, an individual that wishes to be at abeach environment in Hawaii but instead is in a forest environment inLake Tahoe may substitute the images displayed. A person may also bepatched into a vacation by viewing the experience of an individual.Alternatively, the substation may be of people, allowing a person suchas a family member that is not present or an avatar of a person who haspassed away may be added to the environment. Alternatively, thebackground images may be changed to allow a dreary dark day changed intoa bright sunny day.

FIG. 27 shows images obtained from a camera may be processed anddisplayed differently in a virtual image versus the physical appearance.A brand may be modified from a first brand to a second brand based onuser settings or advertising bidding. Additionally, a second personwearing the products of a competing brand may be displayed in theaugmented reality system when an individual is look at a first physicalproduct. This may further enable virtual shopping assistants in malls orstores. The virtual shopping assistants may be configured to connect toa call center. Shipping of a physical product may be enabled based onthe purchase of a product in a augmented reality system or virtualworld.

FIG. 28 shows various information presented on the display of a car.This information may be obtained from the camera which images a road andenvironment and displays the information in the glasses, on thedashboard of the car or on the display of a mobile device. Theinformation may further be helpful to police and emergency services. Acamera in the car or the glasses itself may be used to image a person'seyes or other body functions and prevent drunk driving or driving whilesleepy by measuring eye fatigue.

FIG. 29 shows notes and information about various houses, stores,traffic lights from the view of a display. These notes are obtained inresponse to the images obtained from a camera on the mobiledevice/intelligent electronic glasses/headsets. The billboards viewed bya user may change in response to the person viewing the objects.

FIG. 30 shows a camera array network positioned in an environment thatcaptures images of people and objects. For example, a person's eyes maybe captured from the camera array, the information may be processed bycloud server for image recognition purposes, and physical billboard adsmay change in response to the person identified. This may allow for realtime physical world changes in response to the people identified.Alternatively, the billboards may change based on location, GPS, WiFi,NFC, RFID or other location targeting information.

FIG. 31 shows an imaging and diagnostic scanner which scans the eye ofan individual to check the health of the individual. The scanner mayallow for an individual be retrofitted virtually with a variety offrames and allow a person to shop for frames customized to the person'sface.

FIG. 32 shows a headset with a display, flash, camera and microphone.

FIG. 33 shows a variety of items fashioned to be worn on the body thatmay contain various continuous input capture items including cameras andmicrophones.

DETAILED DESCRIPTION OF THE INVENTION

These features and other novel features are described in detail tofurther illustrate and explain with reference to the appended figures.

Referring now to FIG. 1 in detail, describes a mobile device/intelligentelectronic glasses/headset 100 configured with standard features and oradditional special features that define and enable the functionality ofcell phones, laptop computers, personal digital assistant PDA, and othermobile device/intelligent electronic glasses/headsets. The mobiledevice/intelligent electronic glasses/headset 100 is configured with adisplay 101 which may be touch sensitive or alternately not touchsensitive. The mobile device/intelligent electronic glasses/headset 100may be configured with a plurality of display windows and display types.The mobile device/intelligent electronic glasses/headset ischaracterized by one or more device profiles, 102, 103 and 104. Thedevice profile comprising of information such as device model, deviceidentification number, one or more mobile telephone numbers to empowerthe user to program and or select the desired device profile for thedesired purpose and at the desired time. The mobile device/intelligentelectronic glasses/headset user is further enabled to establish, modifyand enable a plurality of user profiles, 105, 106 and 107 for use byitself and or in conjunction with the selected device profiles for thedesired purpose.

The mobile device/intelligent electronic glasses/headset is enabled withthe capability to acquire images by built in camera or external means109, send 110, receive 111, process with a built in processor 112, storeinformation locally 113, recognize and compare image and other patterns114, with the composite functions being represented by 108 for providingthe needed functionality for wired or wireless communication of imagesand other information.

The image entity 120 describes the relationship between the image 130,and video 131 and other collateral and associated information which isdefined as an image profile 121. The image profile 121, comprises ofaudio 140, voice/speech 141, language 150, text 151, handwriting 152,data 160, location 170, time 171, encryption 180, compression 181,description 190, function 191, behavior 192 and relationship 193.

The image 130 and video 131 can be expressed as purely digital data andall of the other information associated with the image profile 121 mayalso be represented as purely digital data. The digital rendering of thecomposite data creates a purely digital image entity 120 comprising ofan image and an image profile. Thus an image entity can be efficientlycommunicated across a wired or wireless physical network, received andsent and further processed for the desired utility to form a virtualnetwork composed of images and associated image profiles. As an examplean image entity can be viewed just as an image only or activated todeliver voice, music or other functions by selecting the functionalityby appropriate interface means such as touching a portion of the image,by voice command and or other means.

Efficient communication is achieved through compression anddecompression as may be appropriate at the send or receive side of adevice in the physical network. The conversion of voice, speech, textand handwriting is enabled by digital processing of the data at themobile device/intelligent electronic glasses/headset level, the localserver level, the central server level, the network server level and orthe network server level to provide enhanced utility to the mobiledevice/intelligent electronic glasses/headset user based on mobiledevice/intelligent electronic glasses/headset profiles and or userprofiles. The behavior of an image by itself and or in relation to otherimages is capable of being modeled. The dynamic construction, storageand use of a virtual image entity is enabled by software means using thesoftware, processing power/databases/lookup-tables resident within themobile device/intelligent electronic glasses/headset and or inconjunction with the software, processing power/databases/lookup-tablesresident in a physical network at the local, central, escrow and or thenetwork server by fully leveraging the wired or wireless connectivity.

In the present system a plurality of device profiles and user profiles,with the capability to acquire images and related information by mobiledevice/intelligent electronic glasses/headset means, capability torecognize the images and compare the images, and the capability to send,receive, process and store by wired or wireless communication means isdescribed. The image further being described as a virtual image entityby software means wherein the image entity comprises of an image profilethat associates the image with collateral information such as audio,voice, text, speech, location, time data, handwriting,encryption/decryption, compression/decompression, description, behavior,function and relationships to other images/aspects to form an imageprofile.

An image entity thus is unitized as a distinct and identifiable digitalentity, said unitized image entity having embedded multimediacapabilities, location, security and executable functions that areinherently associated with the image with the added ability to launchthe desired multimedia method for rendering and or actuating a desiredvirtual or physical function. The unitized digital image entities arelinked together to form an image network/augmented reality network withthe ability to send the selected unitized image entity across a physicalnetwork or across one virtual image network/augmented reality network toanother and or propagate an entire image network/augmented realitynetwork across a physical network to a mobile device/intelligentelectronic glasses/headset, servers and other devices for deliveringutility to the user based on device/user profiles. The linking of imageentities to form a image network/augmented reality network isrelationship based, where the user defines the relationship or therelationship is learnt by software means based on the past user behaviorpatterns and potential user behavior patterns.

A mobile device/intelligent electronic glasses/headset is enabled in thepresent disclosure to digitize and unitize an image entity by means ofthe software/processing power, storage/databases/lookup-tables residenton the mobile device/intelligent electronic glasses/headset and or inconjunction with the software/processing power,storage/databases/lookup-tables resident on the local, central, escrowand or network servers leveraging the high speed wired or wirelessconnectivity between mobile devices, intelligent electronic glasses andstationary devices. Currently, transmission across a digital network isby means of digital packets. The image entity is composed of digitaldata packets. However, these packets of digital data have a pre-existingrelationship in the form of an image entity that is digitized andunitized. The image entity may be described as a super sized packet ofdigital data enabling the transmission of image entities efficientlyacross a network to dynamically construct/deconstruct and switch androut image entities in an image network/augmented reality network.

Referring now to FIG. 2 in detail, the image entity 200, the imageentity 210 and the image entity 230 form a basic image network/augmentedreality network wherein the image entities are virtually connected bymeans of the relationship 231, 232 and 233. The relationship betweenimage entities is defined and executed in software which is resident onthe mobile device/intelligent electronic glasses/headset and or theservers. The relationship data is further stored in lookup-tables forenabling dynamic lookup of a relationship between images for providingefficient routing and delivery of the image and the image profile acrossan image network/augmented reality network.

Referring now to FIG. 3 in detail, a plurality of image entities, 300,310 and 330 comprise an image network/augmented reality network withdefined relationships 330, 331 and 332 which describe the detailed andspecific relationships between each image entity. The image entity 300comprises of sub image entities 301, 302, 303, and 304 that share arelationship with each other in addition to the parent image entity 300.The image entity 310 comprises of a set of constituent sub imageentities that are labeled as 311, 312, 313, and 314. These sub-imageentities share a relationship to portions of the larger image entity310. The image entity 320 comprises of a set of constituent sub imageentities 321, 322, 323, and 324. These sub image entities deriveproperties from sections of the larger image entity 320 and includecertain attributes and parameters that are not explicitly part of image320.

Referring now to FIG. 4 in detail, a plurality of super image entities,400, 410, 420 comprise an image network/augmented reality network withdefined relationships 430, 431, and 432. The super image entity 400maintains relationships with image entities 401, 402, 403, and 404. Therelationship between image entity 400 and 402 is determined by therelationship between image entity 400 and 401 and the relationshipbetween image entity 401 and 402 and or other combinations. The imageentity 420 and 430 may maintain similar or other types of serial,combinational and or hierarchical relationships with their respectiveconstituent images.

Further referring now to both FIG. 3 and FIG. 4, the foregoingarchitecture, system of organizing and establishing virtualrelationships between various super image entities, image entities andsub image entities enables the dynamic construction of highly useful andrelevant image network/augmented reality networks. The software forconstructing, deconstructing, modifying and enabling of the imagenetwork/augmented reality networks may be reside within the mobiledevice/intelligent electronic glasses/headset and or the servers withspecific protocols and complex algorithms being employed using theprocessing power and data bases of one or more mobile device/intelligentelectronic glasses/headsets by itself, in combination and or inconjunction with a local, central, escrow and or network server. Theimage network/augmented reality network may be transformed or modifiedautomatically, based on device and user profiles and rendered for aspecific purpose and or for a specific duration with the desiredsecurity levels. The security key for a virtual image network/augmentedreality network may be dynamically enabled by a mobiledevice/intelligent electronic glasses/headset acting alone and or inconjunction with an escrow server.

Referring now to FIG. 5 in detail, the mobile device/intelligentelectronic glasses/headset represented by the legend CT/MID andcomprises of one or more display windows and display types inclusive ofa touch screen enabled display 505, an image acquisition unit such as abuilt in or external camera 506, a transmit/receive unit for enablingwired or wireless communication 507. The mobile device/intelligentelectronic glasses/headset acquires the image of an object dynamicallyand in real time. The object entity 500, describes the object in detailby means of an object profile 504. The object profile comprises ofobject description 501, object form, object function, object behavior,object relationships together represented as a group 502 and the objectidentification and object communication together represented as 503.Additionally, the object may be identified by one or more identificationmethods inclusive of radio frequency enabled tags and embedded chipsthat enable either one way or two way communication between the object,the mobile device/intelligent electronic glasses/headset and or theservers. Another method of object identification and communication is bysound based methods wherein an audible signal is emitted or received.The RF and or other methods enable specific digital information to betransmitted and or received. The present disclosure enables theintegration and intelligent combination of the object identificationobject profile data rendered in digital form to be associated with anobject, object network, an image and an image network/augmented realitynetwork.

Referring once again to FIG. 5 in detail, the mobile device/intelligentelectronic glasses/headset is configured to create and output and sendby wired or wireless means an image entity 508 comprising of an image509 and an associated image profile 510. The image entity may betransmitted by wired or wireless means to an image switch/router 520,further processed within the image switch/router and sent across thephysical network to a local server 521, central server 522, escrowserver 524 and or a network server 523; or to other mobiledevice/intelligent electronic glasses/headsets 594/user 596 and mobiledevice/intelligent electronic glasses/headset 595/user 597, stationarydevice 590, image sensor 591, intelligent sensor 592 and intelligentdevice 593. The image sensor is enabled for acquiring andtransmitting/receiving image providing a real time response to actualimage, change in images and other related information wherein theinformation may be rendered as an image entity by the image switch, themobile device/intelligent electronic glasses/headset, the servers and orthe image sensor itself.

The mobile device/intelligent electronic glasses/headset user by meansof the mobile device/intelligent electronic glasses/headset is enabledto dynamically construct and deconstruct various types of imagenetworks/augmented reality networks 530, for the desired utility andassociate these networks with a desired user profile and or a mobiledevice/intelligent electronic glasses/headset profile. The imagenetwork/augmented reality network comprises of constituent imageentities 531, 532, 533, 534 and 535. Similarly another imagenetwork/augmented reality network 540 and 550 may be constructed.Similarly a virtual object network 580 is enabled comprising of relatedobjects and sub objects.

The utility of an image network/augmented reality network is derivedwhen the virtual image network/augmented reality network is accessibleby one or more mobile device/intelligent electronic glasses/headsets573, 572, and 571 comprising a device network 570 which in turn isconnected by wired or wireless means to other stationary devices,intelligent devices, intelligent sensors, image sensors, local servers,central servers, escrow servers, and network servers. The physicalnetwork formed in this manner enables the innovative software to bedeployed at one or more devices/servers providing the means forconstructing and implementing image networks/augmented reality networksby leveraging the processing power/databases/lookup-tables at thedesired nodes in the physical network and or a combination of nodes inthe network.

The utility to one or more individual users 596 and 597 is furtherenabled when the virtual image network/augmented reality network is theeither a preferred or necessary medium of communication between usersbecause of ease of use. Additionally, individuals may form a virtualnetwork of people joined together for a specific purpose such as socialnetworks, professional networks, enterprise networks, family networks,friends networks and other networks. Such virtual people or socialnetworks are represented by 560 with specific individuals and theirrelationships with each other being represented by 561, 562, 563, 564and 565. Each user in such people or social networks has one or moreprofiles and is enabled to form multiple people or social networks. Thepresent disclosure teaches the means for propagating an image entity toa specific device/user and or to a plurality of devices/user enablingthe people or social networks to be a viable means for a rich andmeaningful communication and interaction. An image entity or a series ofimage entities may be propagated to the desired devices/users at thedesired time and for the desired purpose enabling imagenetwork/augmented reality network based multimedia communication that isrelevant in a highly interconnected digital world. Further the imageentity is replicated and delivered and placed in specific nodes of oneor more people or social networks of a user and or one or more people orsocial networks of a plurality of users.

Referring now to FIG. 6 in detail, the Image Switch/Router 610 comprisesof an I/O processor, 611 for the processing of image entities as inputsand outputs; a digitizer and formatter 612 to enable the inputs/outputsto be digitized as needed and formatted as needed for furtherprocessing/send/receive/storage. Means for encryption/decryption, 614 ofoutgoing image entities, wherein each image entity may be encrypted atone or more levels of security and various sub image entities may beencrypted at one or more different levels of security for providinggranular security.

The image switch/router further comprising the capability for patternrecognition of images by the image processor, 615, a means forcomparison of images and image profiles 616, a general purpose processorand one or more special purpose processors, 618 for processing audio andother digital signals, a means for storage and means for establishinglookup-tables, 619 and an I/O manager for enabling the desired switchingand routing across a physical network or the virtual imagenetwork/augmented reality network.

The inputs to the image switch/router consist of an image entity, 600that further comprises of an image, 601 and an image profile, 602. Theoutputs to the image switch/router consist of an image entity, 630 thatfurther comprises of an image, 631 and an image profile, 632. Theforegoing architecture is for illustrative purposes and the novelfeatures of processing an image entity may be executed by software by asingle processor and other modifications to form an image switch/routerfor switching and routing of images in an image network/augmentedreality network.

The image network/augmented reality network, 640 comprising of sub imageentities 641 through 645; the image network/augmented reality network,650 comprising of sub image entities 651 through 652 and the imagenetwork/augmented reality network, 660 comprising of sub image entities661 through 663 are virtual entities that exist on the network at one ormore nodes and storage devices. The entire image network/augmentedreality network such as 640, 650 and 660 and or a specific image entitywithin these image individual image network/augmented reality networksmay be swapped from one network to another by image switching androuting; and or generally sent across a physical network to a physicaldevice by means of routing tables/protocols 670, 671 and 672.

The novel system of the present disclosure thus enables an image to belinked with its associated profile, the profile further having audio,text, data and other information to form an image entity that is purelydigital and virtual; enabling the image entities to be linked togetherby a user defined relationship to form a virtual image network/augmentedreality network which can be propagated across a physical network to aphysical device for the desired display format and or further utility tothe user based on device profiles and user profiles. The utility may bederived by visual means only and or coupled with other mediums such asvoice, text and others since the image entity comprises of suchcollateral forms of information.

The actuation of the image entity may be executed by a plurality ofinterface methods to access the specific digital data individually andor in combination inclusive of the capability to launch an applicationthat performs a specific function and or action, said functions andactions being virtually executed and or physically enabled. An exampleof this is by clicking on an image of a garage door the door may beopened or closed. Another example is the image entity may be associatedvirtually with another image entity. For example the image of a car, acar whose image is characterized and related to the home owner, that isapproaching the garage from the outside may cause the garage door toopen, since these two images are linked by a relationship that waspreviously defined and approved by the user. The garage door wasphysically opened in this example since the software caused a functionto be executed. The behavior can also be learned based on user definedprofiles. Thus image based networks of the present disclosure are ofgreat utility and practical applications. An image based network mayinclude still images and video.

Referring now to FIG. 7 in detail, a plurality of objects, 700, 710 and720 comprise an object network with defined relationships 730, 731 and732 which describe the detailed and specific relationships between eachobject. This forms an object network describable in software as anobject network. The object when coupled with its associateddescriptions, identification, parameters and relationships is defined asan object entity. The object entity 700 comprises of sub object entities701, 702, 703, and 704 that share a relationship with each other inaddition to the parent image entity 700. An example of this is a sidechair of a dining table ensemble with four legs wherein the chair andthe legs of the chair have a defined relationship that may be describedin software as an object sub-network. The image entity 710 comprises ofa set of constituent sub object entities that are labeled as 711, 712,713, and 714. These sub-image entities share a relationship to portionsof the larger image entity 710. As an example this object sub-networkmay represent in software an arm chair within the same diningtable-chair group. The image entity 720 comprises of a set ofconstituent sub image entities 721, 722, 723, and 724. These sub imageentities derive properties from sections of the larger image entity 720and include certain attributes and parameters that are not explicitlypart of image 720. The object entities 700, 710 and 720 form an objectnetwork that is virtually defined by a software program. The objectnetwork may be linked to various real images of the different objects toenable a real visual representation forming a virtual imagenetwork/augmented reality network that is of utility as explainedelsewhere in the present teaching.

Referring now to FIG. 8 in detail, a plurality of super object entities,800, 810, 820 comprise an object network with defined relationships 830,831, and 832. The super object entity 800 maintains relationships withobject entities 801, 802, 803, and 804. The relationship between objectentity 800 and 802 is determined by the relationship between objectentity 800 and 801 and the relationship between object entity 801 and802 and or other combinations. The object 820 and 830 may maintainsimilar or other types of serial, combinational and or hierarchicalrelationships with their respective constituent objects.

Further referring now to both FIG. 7 and FIG. 8, the foregoingarchitecture, system of organizing and establishing virtualrelationships between various objects that may be animate or inanimateis of great utility especially when associated with a real image or avirtual computer generated image enabling the user to visualize, designand even actuate the desired function of an object or cause a desiredtransformation of form and function of a physical object by remotenetwork access means. Ability to establish an intelligent relationshipbetween super object entities, object entities and sub object entitiesenables the dynamic construction of highly useful and relevant objectnetworks. The software for constructing, deconstructing, modifying andenabling of the object networks may be reside within the mobile deviceand or the servers with specific protocols and complex algorithms beingemployed using the processing power and data bases of one or more mobiledevices by itself, in combination and or in conjunction with a local,central, escrow and or network server. The object network may betransformed or modified automatically, based on device and user profilesand rendered for a specific purpose and or for a specific duration withthe desired security levels. The security key for a virtual objectnetwork may be dynamically enabled by a mobile device acting alone andor in conjunction with an escrow server. The object networks may beinterrelated with the associated image network/augmented realitynetwork.

Referring now to FIG. 9 in detail, an object may be viewed from theoutside from all 360 degrees of angle to present the best visualrepresentation of its characteristics. At times it is not possible toobtain a full 360 degree view and a visual representation must berendered by extrapolation means. A mobile device and or other devicesmay be used for image acquisition for obtaining a full or partial realand visual representation of the object. The object 900 with theassociated object profile 901 forms an object entity. The object profilecontains detailed information about the object such as object type,object identification by RF tag or other means, object relationships andother relevant information.

The object entity 900 may be viewed by a camera, image sensors or otherimage acquisition methods from all angles when physically possible toget an image with an associated image profile to form an image entitythat best describes the object when viewed from that particular angle orvantage point. The Image entities 910, 920, 930, 940, 950, 960, 970 and980 represent the view from different angles. The representation isintended to be 3D spherical and not two dimensional.

Example of an object that may be viewed from the outside is a home. Inthe event the full view from all angles is not possible due to lack ofaccess, then it is possible by software means to extrapolate usingvarious algorithms to render an image that is most representative. Theability to generate image entities with a mobile device and or othermeans is enabled, to represent an object and construct an object networkand or an image network/augmented reality network. The imagenetwork/augmented reality network is represented as 990 showing an imagenetwork/augmented reality network of all the images thus generated withtheir respective image profiles.

Referring now to FIG. 10 in detail, an object may be viewed from theinside from all 360 degrees of angle to present the best visualrepresentation of its characteristics. At times it is not possible toobtain a full 360 degree view and a visual representation must berendered by extrapolation means. A mobile device, image sensor and orother devices may be used for image acquisition for obtaining a full orpartial real and visual representation of the object. The object 1000with the associated object profile forms a super object entity that isbeing represented from the inside. The mobile device, image sensor andor other means for image acquisition is represented by 1001.

The object entity 1000 may be viewed by a camera, image sensor or otherimage acquisition methods from all angles when physically possible, toget an image with an associated image profile to form an image entitythat best describes the object when viewed from that particular insideangle or vantage point. The Image entities 1010, 1020, 1030, 1040, 1050,1060, 1070 and 1080 represent the view from different angles. Therepresentation is intended to be 3D spherical and not two dimensional.The image network/augmented reality network image network is representedas 1090 showing an image network/augmented reality network/augmentedreality network of all the images thus generated from the inside withtheir respective image profiles.

The image network/augmented reality networks generated from the insideand or the outside represent the object enabling these virtual imagenetwork/augmented reality networks to be stored, further processed orsent to the desired mobile device, stationary device and or the serversin a physical network. The ability to construct/deconstruct/modify/storeand generally render the image network/augmented reality networks to beuseful is enabled by means of the mobile device acting by itself and orin conjunction with other mobile devices/intelligent electronicglasses/headset, sensors and servers leveraging the software, processingpower, storage, databases, lookup-tables and wired or wirelessconnectivity in a desired manner by the user at the desired node in aphysical network. The image acquisition may be means of light in anywavelength, by sound, by electromagnetic means such as RF and othermethods.

Each physical object and subsets of an object may be uniquely identifiedand represented by a plurality of characteristics, relationships andbehavior patterns. The identification of an object and or subsets of anobject may be by attached or embedded RF tags or chips wherein the tagsand chips contain the relevant information such as form, function,colors, size, relationships and other parameters. Additionally soundbased methods may be used for location determination in an environment.Location may be determined by GPS, global positioning means. The abilityto time stamp and location stamp the original object entity definitioncoupled with the precise location and time of the construction of anobject network is enabled. The objects transmit/receive data by means ofthe communication tags/chips enabling the data to be characterized andenabling placement of the object entity in a virtual object network. Theconstruction, deconstruction, modification and storage of the objectnetwork is also time stamped, location stamped and author stamped bysoftware means. Similarly, the original definition of the virtual imageentity is, author, time and location stamped by software means. Theplacement of each image entity in a virtual image network/augmentedreality network is also author, time and location stamped by softwaremeans enabling the discovery trail of one or more actions. Theconstruction, deconstruction, modification and storage of the imagenetwork/augmented reality network is also time stamped, location stampedand author stamped by software means.

The object may be defined as an object entity with a plurality of objectprofiles or no object profile. The object network may be defined with aplurality of object network profiles or no object network profiles. Theimage may be defined as an image entity with a plurality of imageprofiles or no image profile. The image network/augmented realitynetwork may be defined with a plurality of image network/augmentedreality network profiles or no image network/augmented reality networkprofiles. The foregoing teaches the means for object and imagenetwork/augmented reality networks to be enabled dynamically and in realtime.

Referring now to FIG. 11 in detail, the physical network located locallyor on an extended network or the Internet with wired or wirelesscommunication capabilities comprises of an Image switch router 1140 forenabling the switching and routing of image entities and imagenetwork/augmented reality networks, an intelligent device 1141 such as aTV and other devices, an intelligent sensor 1142 for sensing andtransmitting/receiving one or more conditions such as images,temperature, radiation levels and other conditions, one or mobiledevices 1144, one or more users 1143, central server 1145, networkserver 1146, escrow server 1147, stationary device 1148 and local server1149.

The controller 1120 may be a remote controller or a mobiledevice/intelligent electronic glasses/headset that performs theadditional functions of the controller in an image network/augmentedreality network and or a standard non image network/augmented realitynetwork. The mobile device/intelligent electronic glasses/headset may beconfigured to perform the functions of a controller 1120 by itself andor in conjunction with the processing power of the local, central,escrow, the network server and the image switch/router. Alternately someor all of the functions of the controller may be incorporated in one ormore devices and the display. The controller comprises of differenttypes of actuation, command, control and function enabling features andserves as a means for interfacing with one or more devices, servers andthe display. The controller function may be embedded in a mobiledevice/intelligent electronic glasses/headset.

One type of interface is by means of touch 1121 further comprising oftactile 1122, keyboard 1123, pen or stylus 1124, and finger 1125.Another type of interface may be by optical means 1130 inclusive oflight pointer 1129, infrared 1128 and other types of laser and opticalmethods, wherein the act of pointing at an image activates the imageentity and launches an application. Other gesture level controls may becreated and mapped to functions. In addition another interface means issound based 1127 by one or more methods. Another type of interface andcommand and control is by RF means, 1126. The image entity or the imagenetwork/augmented reality network is enabled to execute certain desiredfunctions by the appropriate command and control interface methods bymeans of the function selector 1132.

The biometric command, control and authentication features 1133 areenabled by means of fingerprint 1134, photo identification 1135, retinalscan means 1136 and speech/voice recognition means 1137 with languagetranslation 1138. The controller function is enabled by wired orwireless methods of communication. The controller enables a high degreeof personalization to the profiles of different devices and users withthe added capability for behavior modeling and response by means of theprocessing capability of the controller by itself and or in conjunctionwith a local, central, escrow and network server. The escrow server orthe central server performs trusted authentication for a desired actionor activity related to any network or any function thus providing a highlevel of security to the user and the integrity of the network.

The display 1100 may be a standard non touch screen display such a CRT,plasma, LCD or other methods. The display may be touch screen enabled.The display may be integrated into a lens of an intelligent electronicglasses. The display may be a small display with high resolution that ismay be placed in front of one or two eyes. The display may comprise ofone or more physical or virtual display areas for the desired utility.Different windows are enabled within the display of same or differenttypes of interface. These windows may be dynamically updated by theglasses, other mobile devices, or servers.

The display is part of the physical network enabled for communication bywired or wireless means with other devices. In another novel embodimentof the present disclosure, the display is configured with one or moreprocessors, storage, databases, lookup-tables and software to enabledynamic adjustments of the entire display area and or the adjustments ofany localized area down to the pixel level for delivering images, imagenetworks/augmented reality networks and video to the personalizedviewing preference of the user.

In another novel embodiment of the present disclosure, the displayconfiguration and settings may be learned to the behavior patterns ofthe user for a specific type of image, image network/augmented realitynetworks and video. In another embodiment of the present disclosure thespatial distortions across the display area, the aberrations in colorand intensity of different images is also dynamically managed by localprocessing within the display and or in conjunction with the tremendousprocessing power of one or more servers. These features are dynamicallyand in real time enabled by means of the software, processing power,storage, databases and lookup-tables resident on the display itself andor in conjunction with the software, processing power, storage,databases and lookup-tables resident on the mobile device/intelligentelectronic glasses/headset, controller, local, central, escrow and ornetwork server.

Referring to FIG. 11 in detail once again, the display area isconfigured with an optional tool bar 1101. The tool bar is actuated byone or more interface methods as described with reference to thecontroller 1120. The tool bar as an example may be activated by voice,speech, light pointer, touch and other means as preferred and selectedby the user for close-up or remote activation by means of thecontroller, mobile device/intelligent electronic glasses/headset oranother device. The tool bar is enabled to launch and activate one ormore applications such as show an image, play video, audio, music and orlaunch a command and control function such as see what is in therefrigerator and display the contents of the networked intelligentrefrigerator or other intelligent devices. The tool bar is furtherenabled to launch one or more functions to access web servers located onthe Internet and or servers located on the Intranet, for surfing,content and or other activities. The tool bar is capable of performingthe functions of a traditional Internet browser of the prior art andother enhanced functions and being activated by multimedia command andcontrol features.

The display configuration described in the embodiment of the presentdisclosure is all digital communication and processing enabled andrelates to mobile device/intelligent electronic glasses/headsets andalso stationary intelligent devices such as a Television or a monitor toprovide a very high definition and high fidelity multimedia experience.

Referring to FIG. 11 once more in detail, the images and theirassociated image profiles form an image entity rendered digitally as aunique entity. The display is configured to show a series of images onlyor image entities separately or as an image network/augmented realitynetwork. As an example the entire display area is denoted by the imageentity 1102, and the actual image being displayed is denoted by Screenimage 1103. The viewer sees the super image which gets updatedperiodically with another super image at the desired rate for bestvisual experience. The visual experience is formed by viewing a seriesof super images that are refreshed and updated at an optimal frequency.As an example the image entity 1104 comprises of a series of sub imageentities 1105, 1106 and 1107 with a defined relationship to the imageentity 1104. The image entities 1108 and 1109 are shown separately asbeing part of screen image 1103. Another super image entity 1110comprising of image entities and sub image entities 1111, 1112 and 113are shown. These features are shown for illustrative purpose whereas inreality the screen image is comprised of a large number of imageentities of varying sizes and characteristics with a definedrelationship to each other and another defined relationship to thescreen image. These images are dynamically rendered, delivered, modifiedand updated to deliver the best screen image. The screen image is bythis means configured as a image network/augmented reality network thatgets updated at the desired periodicity. The control over the viewingexperience is achieved by enabling granular control over image entitiesin this image network/augmented reality network wherein the imageentities may also be updated at the desired periodicity or desiredattributes. This feature enables the screen image or portions of thescreen image to be dynamically tuned for the preferences of the user.The granular control of delivering image entities efficiently makes thequality superior. Additionally, the image entities may be modified tofit the desires and viewing experience of the user. The ability to dothese transformations in real time is enabled by means of the software,processing power, databases and lookup-tables resident within thedisplay and or in conjunction with the software, processing power,databases and lookup-tables resident within the controller, mobiledevice/intelligent electronic glasses/headset, to provide a high qualitymultimedia viewing experience. Additionally functions and applicationsmay be launched by touching and or pointing at certain images and or theentire screen. Additionally the touch and or pointer and or other meansof activation is enabled to show relationships to the image in the formof text, voice and other attributes related to that specific image orsubsets of the image or the entire screen.

Referring now to FIG. 12, the camera and display may be integrated intoan intelligent electronic glasses 1201. The glasses may be incommunication a mobile device 1202 and cloud servers 1203 for local ornetwork processing. The glasses may be enabled with a projector 1204, afront facing camera 1205, lens 1206, and laser 1207. The projector 1204may project an image such as a keyboard or dialpad 1209 on to a surfaceincluding a hand 1208. The camera 1205 or laser 1207 may track themovement of another object such as a finger 1210 to determine where thecontact was made with the surface of the hand. Multiple communicationpaths between the devices may be enabled as in 1211, 1212, and 1213using WiFi access points, Cellular towers, or other communication links.A plurality of antennas 1214 may be integrated into the frame or otheraspects of the glasses. Processors, wireless radios, and sensors may beintegrated into a common housing built-in or attachable/detachable fromthe glasses. A display may be added to the housing 1215 that isrotatable and position-able in front of the lens 1206. Alternatively thehousing 1215 may be positioned on the side frame and rotated in front ofthe lens 1206. The glasses may be customized with various frames andbrand names. The smartphone 1202 may further provide the same functionsas the glasses when integrated with a projector and camera or laser.

Referring now to FIG. 13, a watch 1301 with a projector 1302, display1303, camera 1304, second camera 1305, antenna 1306, laser 1307, andradio may be used to project a keyboard image onto a surface including ahand 1308 and capture interaction with the projected item.Alternatively, a smartphone 1311 with a projector 1312, display 1313,camera 1314, antenna 1315, laser 1316, second camera 1317, and wirelessradio may be used to project onto a surface including a hand 1308 andcapture interaction with the projected item. The projected items mayinclude keyboards. The projection may be done after recognizing areas ofthe surface such as the palm 1309 and fingers 1310. The projectedcharacters may be updated as actions are taken on the hand. For example,as digits are entered the telephone number to call may be displayedprogressively. A second camera on the device such as 1305, 1317 may beused for eyetracking purposes to further capture the focus area of theeye and map that to the specific coordinates of the projected item onthe surface. Multiple cameras or lasers may be used in conjunction toimprove the fidelity including components available on intelligentelectronic glasses 1318 if available. In addition, the local processingpower of proximate devices 1301, 1311, 1318 or cloud based servers 1319may be used for image recognition. The actions may further result in APIcalls, two way communication and other data updates between the localdevices 1301, 1311, 1318 and servers 1319.

Referring now to FIG. 14, a pair of glasses 1401 is configured with adisplay 1402 integrated into the lens 1403, a camera 1404, andmicrophone 1405. The lens 1403 is split in two areas. The top area is atraditional see through glass, a prescription glass, clear plastic, orother material used for lenses. The bottom area 1402 is a displayintegrated into the lens 1403. This allows an individual to look withoutobstruction through the top part of the lens and look at digital contentin the bottom half of the lens 1402. This bifocal lens, trifocal, ornth-focal lens approach may be in one or both lens. The lens 1403 may beremoved from the frame 1407.

A different format for the glasses is displayed in 1408. These glasseshave a camera 1407 and a LCD, LED, high zoom, or other type of display1408. This display may be of varying sizes such as a square 1 inch by 1inch display, longer widescreen display, or smaller or larger displays.The display 1408 may be fastened to a 1409 band, frame plastic item oranother material and further connected to the frame 1411 of the glassesor wrapped around the ear or neck of an individual. The band may containadditional electronics 1410 including a processor, memory, antenna,battery, and wireless transmit and receive radios and control thedisplay 1408. This approach may allow a traditional pair of glasses tobe retrofitted with intelligent electronics. Items 1407, 1408, 1409,1410 may be built-in to the glasses or detachable from the glasses.Alternatively, items 1407, 1408, 1409, 1410 may be used as a headset andwithout the glasses.

Still referring to FIG. 14, a keyboard, keypad, image, icons, or otheritems may be virtually placed on to a surface such as a hand. In thisinstance, the keypad is not physically projected onto the hand. Insteadthe keyboard is superimposed or placed on top of a surface currentlybeing viewed. In this case, they keyboard or keypad 1412 is superimposedonto a persons hand. Various arrangements may be configured such asplacing numbers on specific fingers or placing numbers on the palm. Aperson may interact with the hand by using a finger or other item, tomake contact with the virtual image on a physical hand or virtual hand.The physical hand may be useful to a viewer since it allows the viewer asurface for tactile feedback. However, the physical hand is not neededto type since gestures and contact with the virtual images in thedisplay may serve as a contact or actuation of a specific area. Thecamera 1407 or a laser 1414 may track the hand movement to appropriatecapture the selection of the virtual items. This approach furtherenables privacy since the actual keyboard is not show. The content maybe displayed though on another display such as the miniaturized display1413 or on a mobile device, smartphone, or remote server. A microphone1414 may continuous capture sound that is recorded in the memory orstreamed to a remote server. A speaker may be positioned in the earand/or external to the headset.

Referring to FIG. 15, shows an intelligent electronic glasses 1501 witha front facing digital still or video camera 1502, side facing camera1503, second side facing camera 1504, and a lens 1505 and a display 1506layered on top of the lens 1505. A standard table 1507 may be made intoan intelligent surface with the intelligent electronic glasses 1501. Theaugmented information is displayed on the table top. The cameras 1502,1503, and 1504 capture the gestures of a person's finger and map theactions to the contact areas of the augmented images. Various actionscan be made including actions that involve Internet resources andservers. This may be applied to restaurants where individuals may accessa menu and message a waiter. The device may act in a standalone capacityby communicating directly with servers using a built-in wireless radioand antenna.

Referring now to FIG. 16, a room may be configured with a camera 1601,projector 1602, laser 1603, and lights 1604; all of these objects may bemounted on a wall floor or other surface. These items may each bewirelessly enabled and addressable over Internet Protocol with an IPaddress. A local or network control server 1605 may control thefunctions of the device including the on/off state. The control server1605 may be accessed using a mobile device/intelligent electronicglasses/headset. A media or game server 1606 may be enabled to sendcontent wirelessly or using an HDMI or other wired cable to theprojector, mobile devices, intelligent electronic glasses or headset.This content may in turn be projected on to the table top if the tabletop is non-touch enabled. Alternatively, the table top may be enabledwith a touch screen display, wireless transmit and receive radio,camera, and other electronics. Projected content may be positioned onthe table and allow for games, Internet content, and actions to beactuated by touching the area of the table. For game play, players maybe able to animate their moves such that hand movement produces trailsof movement similar to dust in the air or slow motion movement so thatothers can follow the gesture. Each player may be recognized by theimage of their hand 1609. Alternatively, content such as images acquiredduring the day from a mobile device or intelligent electronic glasses orheadset and posted to a social network server 1607 may be displayed onthe table 1600. The lights 1604 and speaker may be synchronized to thedigital media including video, images and audio. The digital media maybe streamed from a media server 1606. These activities may be applicableto home theaters, bars, restaurants, and other locations. The functionsdescribed may also be enabled by a mobile device if appropriatelypositioned around a table.

Referring now to FIG. 17, a view from the inside of the glasses 1701 isshown. The display 1702 may be configured to show black and white,color, grayscale images, videos, and text. The glasses 1701 are able toaccess local content available on a proximate mobile device and distantcontent available on network or Internet servers. Various notificationservices are available that automatically update specific areas of thedisplay 1703. For example, weather changes may automatically be updatedon the display. Alternatively, activity feeds from social networks 1704may additionally be available. The device may further be display mayfurther provide related data such as recent call history and calendarappointments. In a fully standalone mode, the intelligent electronicglasses may function as a cellular telephone. In a paired mode, theintelligent electronic glasses may function in collaboration with amobile device including a cellular telephone. In this instance theintelligent electronic glasses requests specific data from the mobiledevice using an API and communication protocol such as Bluetooth orWiFi.

The glasses 1701 may further be enabled with a microphone. The audiocaptured from the microphone may be automatically converted from spokenaudio to text using the processing power resident on the intelligentelectronic glasses, a mobile device, or a local or network server. Thetext of the audio conversation may be shown as translated in thedisplay. This may be valuable for individuals that are hearing impaired.Further, as words are translated, content may be dynamically searched onthe Internet or another server to provide related information to thespoken audio. This search and relation may be performed automatically ormanually and may be predicted using behavioral models. These behavioralmodels may suggest related conversation topics or perform internetsearches during the conversation. For example, when a new person isencountered, the audio system may recognize the voice of the person orthe camera may recognize the face of an individual and identify theperson using a database located on a social network. Further, the devicemay automatically search keywords from the conversation and presentresults in the display 1705. A user may browse the internet and usespoken commands to control the display. Various commands may beavailable in one or more toolbars 1703 and 1706. Content in the displaymay further be updated dynamically based on the context includinglocation.

Referring now to FIG. 18, is the back side of the intelligent electronicglasses 1801. The glasses 1801 may be configured with a rear view camera1802 that captures video and images behind the glasses. A side camera1803 may capture peripheral imagery. These images and video may becombined together to provide 3D and 360 degree video experiences forfuture playback. The rear camera 1802 may further be used so that anindividual need not look behind themselves to see what is occurring.

The glasses may further be used in a shopping experience. Offers andcoupons may appear in the display 1805, 1806, and 1807. Advertisers maybid on space on the lens in real time using real time bidding exchangesand platforms. Advertisers may also make bids to offer discounts, deals,and coupons based on the location of the glasses and the object beingviewed. In FIG. 18, an ice cream cone is being viewed in the glasses.The price of the product may appear in the left display 1805. Acompeting offer from a related vendor may appear in the bottom rightdisplay 1806. Alternatively, a camera may capture an image of a book,send the image to a local or network server for processing, and theserver in turn may return data and meta data about the book includingprice comparison shopping data. This meta information may be viewable onthe display or projected. A person may purchase the book using a mobiledevice or the intelligent electronic glasses or headset using thedisplay or spoken audio commands.

Referring now to FIG. 19, a mobile device or intelligent electronicglasses may stream content to a television or other display. Content maybe streamed directly from the mobile device or glasses 1901. The contentmay also be streamed to a remote person or server. In another instance,content may be displayed on a television or streamed from a televisionserver to a variety of devices. When content is displayed on atelevision, a person may view the content through the glassesunobstructed. The glasses 1901 may record the displayed content and sendthe content to a remote person 1903 to view the displayed content on thetelevision. The remote person may view the content in a web browser ortelevision or mobile device or intelligent electronic glasses. Theremote person 1903 may further stream content to a local person'sglasses 1904 and the local person can stream the content to thetelevision 1902. The television may be a smart television, 3Dtelevision, projector and screen. Alternatively, interactive contentrelated to the viewing experience may be displayed in the glasses 1901.Marketers may wish to provide additional information about the cast andcrew of a television show for example. Alternatively, marketers may wishto track the advertising effectiveness of campaigns. The glasses mayprovide an inward facing camera that can track eye movement and focus toprovide better reporting on whether ads were viewed. Participants mayopt-in to this tracking and receive promotions and related discounts.

Referring now to FIG. 20, an intelligent electronic glasses 2001 or amobile device 2002 may capture video and images of an object such as ahouse 2003 using a camera or cameras. This digital content may beprocessed locally on the intelligent electronic glasses 2001 or mobiledevice 2002. Certain intelligent electronic glasses 2001 may not haverobust processing capabilities. In this instance the glasses will sendcontent or stream content wirelessly to the mobile device 2002 or acloud server 2004. Related content may appear in the display of themobile device including price and commerce related information 2005.Alternatively, the content may be made into spoken audio and played inan in-ear speaker 2006.

Referring now to FIG. 21, the cameras on the mobile device 2101 orintelligent electronic device 2100 may function in daylight and nighttime. The devices may be fitted with various computer visioncapabilities and night vision capabilities. Various filters andpolarizations may be implemented in software or hardware to alter theimages.

Referring now to FIG. 22, the mobile devices/intelligent electronicglasses/headset may be used in multiparty conferencing. In this instanceonly person A, 2201, is wearing intelligent electronic glasses. Person A2201 is in communication with a remote person D 2202. The imagesobtained from the camera on Person A 2201's glasses capture the audio,video, images and expressions of Person B and Person C. This data istransmitted wirelessly to Person D 2202. Person D is then enabled toparticipate in the conference by speaking and transmitting spoken audioto the glasses of Person A 2201. The audio may then be emitted from thespeakerphone on Person A 2201's glasses. Alternatively, the audio may beonly played for Person A 2201. This latter scenario may be useful ifPerson A 2201 and Person D 2202 are in a special private collaborationrelationship. This may occur when multiple people from differentorganizations join together for a conference.

Referring now to FIG. 23, all participants, persons A, B, C, and D arewearing glasses. A remote person D 2302 may rotate into the vantagepoint or view point of Person A, B or C. This may allow for enhancedcollaboration as each person can better view the expressions andemotional states of each other. Alternatively, Person D 2302 may viewall participants simultaneously on one screen 2303. The rotation intoanother vantage point of a person may enabled for recording movies inaddition to conference collaborations. As an example, actors may wearcameras that record each seen from each actor's view point. During theviewing experience, viewers may switch into the vantage points ofdifferent characters to have uniquely different movie experiences.

Referring now to FIG. 24, various digital notes and digital comments2400 may be saved and associated with objects. These notes may bespecific to visible to specific users based on authentication and accesscontrol lists. Notes may have a certain time to live and expire based onactions completed or time completed. A physical environment with digitalnotes may be saved, edited, or deleted. An individual may capture animage of an object using a mobile device/intelligent electronicglasses/headset, tap an object on the display screen, and write or speaknotes regarding the object. A person may view the environment using thedisplay of a mobile device/intelligent electronic glasses/headset aspart of an augmented reality view. Each object may be identified usingimage recognition software. Alternatively, labels or bar code images maybe affixed physically to each object and then mapped in a table.Comments may be geo-fenced to particular GPS areas or regions. Eachobject may have various macros and functions associated with them. As anexample, a milk object may be imaged for an expiration dateautomatically. A wine object 2401 may be locked for consumption byindividuals over 21 years of age. A camera in a room may track theconsumption of the object. An alert may be sent to an owner if theobject is consumed. An individual may be identified using location,audio, retinal recognition, or facial recognition. Appliances 2402 maybe locked physically based on the person in a room. If the appliance isrecognizes an individual or is notified of a specific criteria, the doormay be locked. As an example, a family that wishes to prevent childrenfrom eating too much ice cream may set a configuration to lock thefridge door if the person in the room is a child between certain hoursof the day. The child may be imaged by a camera on the refrigerator2402.

Referring now to FIG. 25, a camera affixed to a mobile device 2500 orintelligent electronic glasses 2501 may be used in conjunction. Variousobjects in the distance such as stars 2502 may be identified by atelescope lens. Alternatively, nearby objects may be identified by amicroscopic lens. The information obtained from a camera may be show ona display such as the display on a CT/MD.

Referring now to FIG. 26, cameras may be affixed to a number of itemsincluding shoes. The camera may image various items. An intelligentelectronic glasses may be configured using a toolbar or a softwareapplication resident on a mobile device to substitute various images.For example, certain objects such as pine trees may be substituted withpalm trees in the display. A remote database of related images may beaccessed. Alternatively, a search engine may be used.

Referring now to FIG. 27, a camera 2700 may capture real world contentwhich may be displayed in a mobile device/intelligent electronicglasses/headset 2701. This content may be modified in real time. As anexample, when an individual is viewing content including a person 2702wearing brand A shirt is seen, the image or video displayed may bealtered to show brand B. Other factors such as shirt color or physiquemay be modified. These modifications may be based on user preferences.Alternatively, advertisers may bid for certain people's viewingexperiences or to replace certain brands with other brands.

Referring now to FIG. 28, a camera 2800 may be used in a drivingcontext. The camera 2800 may be integrated into the car, affixed to thecar, integrated into the intelligent electronic glasses, or part of amobile device. Multiple cameras may be used. The digital contentobtained from the camera may be processed by an integrated carelectronics or server or on the mobile device/intelligent electronicglasses/headset. The car may be enabled with a heads up display or otherprojected content for images and processed content to appear on thewindshield 2801 of the vehicle. Alternatively, content may appear in thelens of the glasses or the display of the mobile device 2802. A drivermay be able to interact with various touch screen controls in thevehicle. Alternatively, the user may control the on-board electronicsusing gestures or the CT/MD or spoken audio commands. These spokencommands may include control of the A/C and other on-board features.Content may be streamed directly from the mobile device to thewindshield display. The windshield 2801 may further feature ads fromnearby businesses. A video conference may be held and positioned in aseparate area of the windshield such as 2807 to allow for in vehicleconversations that allow the driver to focus on the road. Alternatively,the car may be set into a self-driving mode where an onboard drivingcomputer or the mobile device controls functions of the car includingspeed 2808, acceleration, braking, steering 2809, and vehiclemaintenance. Cars may be enabled with remote vehicle control where aserver can control all the functions of the car.

Still referring to FIG. 28, the roadway may be imaged and scanned by oneor more cameras for potential hazards, traffic data, or other purposes.The hazards and traffic information may appear in a selected area 2803of the windshield 2801. The traffic information may further be sent to amaps, traffic, or location tracking server 2804. The GPS system andnavigation system may be used from the car, mobile device, glasses, orheadset. The cameras may also send data to a crowd-sourced traffic andmapping data base to improve maps of roadways. The driver, licenseplate, make, and model of the car in review may be captured and sent toa database.

Still referring to FIG. 28, an individual may receive predicted drivinginformation such as the need to slow to a specific speed based on turns,traffic, and hazards 2806. The mobile device/intelligent electronicdevices/headset may be used to access an image or video stream severalmiles ahead so that a driver is aware of potential traffic. The drivermay be personally imaged by inward facing cameras to track driverfatigue. The driver may also report other drivers such as potentialdrunk drivers to police, emergency services, or a crowd sourced databaseof suspected drivers. Major traffic violators may have a conditionaldriving license which allows for police or emergency to login remotelyto the vehicle and control all the driving actions of the vehicle from aremote operations center. This remote control may be doneprogrammatically by a computer or by a human on standby. The human inthe remote center may see the entire view from the car on a display on awall, mobile device, intelligent electronic glasses, or headset.Alternatively, a police car or aerial vehicle, such as a helicopter,plane, aerial vehicle, manned aerial vehicle, unmanned aerial vehicle(UAV) 2810 or drone may be sent to obtain information about the vehicleprovided that the appropriate cities and municipalities have approvedsuch usage. These rules may be stored in a network server.Alternatively, an aerial vehicle may be used for electric vehiclewireless charging using induction, resonant magnetic coupling, or othermeans. In this case, the vehicle may be fitted with a wireless chargingpad, battery, AC/DC, converter, controller, and other components andsystem. A UAV 2810 may fly slightly above the vehicle to allow fortransfer of energy from the UAV 2810 to the vehicle using focused beamsor transmitting pads. The UAV may use radar, lasers, or cameras to gaugespeed or distances. This may allow for a driver to avoid stopping at anelectric charging station. Alternatively, charging towers on the roadwaymay be used to charge the vehicle. A UAV 2810 may allow for package andmail delivery, restaurant, or fast food delivery to a stationary ormoving vehicle through a sunroof or window. The UAV 2810 may use aplurality of cameras, wireless transmit and receive units, lasers,sensors, and remote displays for communication. The UAV 2810 maybroadcast these images and videos to a traffic server. These UAV 2810may also be used for elderly care or personal security by tracking andfollowing specific individuals and further recording associated events.Alternatively, the UAV 2810 may be dispatched for managing logistics andinventory, delivering packages from a store to a home, following afriend, and searching for people in the area, signaling for help toauthorities, and providing a actuated map of the area to a phone, watch,intelligent electronic glasses, headset or server. Multiple UAVs 2810,manned vehicles, self driving cars, ground based vehicles, maycoordinate for lane changes, landings, or other activities with eachother using a peer to peer connection or remote server.

Drivers in manned aerial vehicle including low-altitude aerial vehiclesmay also use the mobile device/intelligent electronic devices/headsetfor navigation signs, road markers, and lane markers. The line markersmay controlled by a traffic server or central transportation server suchthat augmented and virtual road signs can be displayed in regions abovethe air. This may allow aerial vehicles to travel on freeways above landbased vehicles. Various vehicles including manned aerial, unmannedaerial, self-driving, ground based vehicles may further contain a servercoupled with wireless transmit and receive capabilities to notify andnegotiate traffic, lane changes, and driving with other local cars.

Referring now to FIG. 29, advertisements on billboards may be modifiedbased on the cars on the roadway or people walking on a street.Billboard 2901 may change its display based on the people around. Theseads may be changed in real time using auctions, exchanges, and real timebidding advertising platforms. Alternatively, virtual billboards 2902may be created and displayed on the car's windshield, individual'smobile device, intelligent electronic glasses, or headset. The virtualbillboards 2902 may be animated and increase or decrease inmagnification. The ads may be delivered by a server 2903. Other objectssuch as a traffic light 2904 may be annotated with information includingtime till the light changes and traffic conditions. These annotationsmay be sent in to the car, mobile device, glasses, or headset.Alternatively, an object such as a traffic light may broadcast a beaconof information. The traffic light 2904 itself may be in communicationwith an Internet, network, or

Department of Transportation private server 2903. This traffic light maybe able to receive remote software updates and maintenance from a server2903. The traffic light may further be enabled with a wireless chargingbeam to allow for vehicle charging from the traffic light to an electricvehicle. The traffic light may be connected to a ground power supply andtherefore be enabled to acquire power relatively cheaply. Drivers maypay additional fees to access these wireless charging networks.

Still referring to FIG. 29, various shops, hotels and restaurants may beaugmented with annotations during the driving or walking experience. Ahouse may appear with objects for sale or a sale price listing 2905. Thedata for the price of the house may come from an online real estate sideor a real estate ad network 2903. A history associated with theindividual may further be appended to the data. This data may comprisecheck-in data, GPS tracking information or other related data.Recommendations from friends and colleagues may additional be integratedinto the augmented reality comments 2906.

For example, a location tracking server may capture the routes traveledby an individual and auto-checkin the individual to various stores.Alternatively, advertisers may bid on the routes 2907 for a specific oraggregate set of people based on time of day, demographics, or otherfactors. Various routes may be suggested to an individual by predictionsoftware resident on a server that accounts for the drivers needs. Forexample, the driver may seek the shortest time, scenic route, likelihoodof finding products/objects that they need to purchase, or ad supportedmonetization route. Advertisers may bid on these routes. Alternatively,a driver may make money by choosing an ad supported monetization routeover a non ad supported route. An ad supported route may take a personthrough an up and coming district of shops. Traffic and maps servers anddata may be used to assist in the routing.

Referring now to FIG. 30, an individual need not wear a camera, mobiledevice, intelligent electronic glasses, or headset to be imaged. Anarray of stationary or mobile cameras may operate as part of an imagenetwork continuously imaging people and collecting audio data with amicrophone. These cameras may capture people's body, face, or retina oreyes 3001. The cameras may be in stores, cafes, malls, roadways, home,office and other locations. Each camera may be addressable with a uniqueIP address. The cameras may send acquired image and video content to acentral server for processing and recognition. Other data sourcesincluding social networks may be used for facial recognition. The cameranetwork may be used for a variety of purposes including tracking missingpeople, delivering targeted advertisements 3002, or providing directionsto a person. The advertisements 3002 may be physical changes to adisplay for a person not wearing a display or virtual changes to adisplay for a person wearing a display. A second camera in the cameranetwork may track whether a person actual saw a given advertisement toimprove reporting and ad targeting. Various privacy settings may furtherbe enabled and individuals may be able to opt-in or out of the networkin return for certain promotions and benefits. As an example, a personwho has opts in to the network may receive daily deals or targetedpersonalized offers 3002. Alternatively, the camera networks may beequipped with wireless power charging stations and allow individuals tocharge devices. Larger cameras may also be placed on top of vehicles oron roadways to target drivers in a car.

Referring to FIG. 31, a stationary or mobile eye examination scanner3101 may be used to appropriately provide glasses, frames, and lenses toan individual. Software on a mobile device in addition to a camera maybe used to image a person. This data may be sent to a private cloudserver for an optometrist or doctor to review. The optometrist may thensend data to an eCommerce website 3103 so that a person may purchaseprescription intelligent electronic glasses or headsets personalized tothe individual. Alternatively, a person who does not need a prescriptionmay image his or herself using the mobile scanner 3101 and have the datasent directly to the eCommerce website or mobile application 3103. TheeCommerce site may suggest and personalize frames and lens to thepreferences and desires for the user. A person may view his or herselfwith a super imposed image of a pair of glasses on their face. A crowdor set of specialists may vote on which frame looks the best on asuperimposed image of the person. The person may purchase the productand have it shipped directly to their current address using a new orstored credit card. Shipping may be done by traditional shippers,self-driving vehicles, UAVs 2810 focused on different distances such aslast mile delivery, or people. A server that tracks the routes of peoplemay be able to find the best person to deliver a product from a store toa person. People can agree to be personal shippers in this network. Aserver can assign shipments to people based on their travel routes. Forexample, a person that drives by a store on the way home from work mayagree to deliver products for that store to neighbors in the person'szip code or neighborhood social network. People and purchasers may payfor shipment using a payment network or digital wallet. This samepayment system may be associated with a person's glasses such thatcredit card information is stored on a server to enable shopping withtheir glasses.

Referring to FIG. 32, shows an alternative version of the headsetfashioned as a headband 3200. The headband has a hinged display, flash,microphone, speaker, and camera. This headband may be more appropriatefor athletes or bikers.

Referring now to FIG. 33, a variety of fashion items including anecklace or medallion 3301, earrings, ring, or belt may be fitted withmicro-cameras, antennas, wireless transmit and receive radios, battery,and memory to aid in acquiring information about the environment. Otherdevices may have GPS monitors or accelerometers. These devices may worktogether and stream data to a mobile device, glasses, or a remoteserver. Each device may broadcast their capabilities includingmegapixels for the camera, camera orientation, storage capacity, batterylife, and processing power. A mobile device may prioritize the variousdevices for collecting inputs.

It is anticipated that the various components disclosed herein includingcameras, displays, sensors, wireless T/R may be integrated into avariety of devices and environments. The disclosure herein hasapplicability to a variety of contexts including travel, transportation,shopping, auctions, banking, emergency services, visually impaired,crowdsourcing, peer to peer communication, video and audio conferencing,education and learning, negotiations and auditing, sports, news, andother domains.

The foregoing descriptions of specific embodiments of the presentdisclosure have been presented for purposes of illustration anddescription. They are not intended to be exhaustive or to limit thedisclosure to the precise forms disclosed, and it should be understoodthat many modifications and variations are possible in light of theabove teaching. The embodiments were chosen and described in order tobest explain the principles of the present disclosure and its practicalapplication, to thereby enable others skilled in the art to best utilizethe present disclosure and various embodiments, with variousmodifications, as are suited to the particular use contemplated. It isintended that the scope of the disclosure be defined by the Claimsappended hereto and their equivalents.

What is claimed is:
 1. A wireless communications system for imagescomprising: a wireless device comprising a processor, a camera, and awireless transmit and receive component; wherein the wireless device isconfigured to communicate via at least one wireless communicationsnetwork; wherein the wireless device acquires an image using the cameraor an image sensor; wherein the image is compressed to enable efficientcommunication; wherein the image is displayed on a display screen of thewireless device; wherein an object represented in the image isidentified by the wireless device; wherein the object is recognizedusing an image recognition program and comprises a recognized object;wherein the recognized object corresponds to a physical object separatefrom the wireless device; wherein the wireless device displays textrelated to the recognized object on the display of the wireless device;wherein a set of functions or a menu of functions are overlayed ordisplayed on top of the display screen; and wherein the object ishighlighted and/or changed in color in a virtual context.
 2. The systemof claim 1, wherein the text related to the recognized object isreceived from a server, wherein the wireless device comprises electronicwearable glasses.
 3. The system of claim 1, wherein the imagerecognition is performed on a server, wherein the wireless devicecomprises electronic wearable glasses.
 4. The system of claim 1, whereinthe image recognition is performed by a processor on the wirelessdevice, wherein the wireless device comprises electronic wearableglasses.
 5. The system of claim 1, wherein the text displayed on thewireless device display is dynamically generated by a server in responseto the image being acquired by the camera or the image sensor and theobject being identified by the wireless device, wherein the wirelessdevice comprises electronic wearable glasses.
 6. The system of claim 1,wherein the wireless device executes a function in response to theselection of a specified image area corresponding to the objectidentified by the wireless device and wherein the function controls thephysical object, wherein the wireless device comprises electronicwearable glasses.
 7. The system of claim 6, wherein the functioncomprises controlling an on/off command.
 8. The system of claim 6,wherein the recognized object is a garage door and wherein the functioncontrols a physical garage door.
 9. The system of claim 6, wherein apattern matching software is executed to identify objects in an imagesent by the wireless device to a server.
 10. A system for interactionwith virtual and physical items using a wireless device comprising: awireless device further comprising a display used for viewing images anda camera, wherein the wireless device acquires an image using thecamera, wherein the image acquired by the camera is compressed to enableefficient communication, wherein the wireless device presents the imageacquired by the camera on the display used for viewing images in thewireless device, wherein a function sends to a server connected to theInternet the image acquired by the camera, wherein the server connectedto the Internet performs image recognition on the image acquired by thecamera, wherein the server connected to the Internet sends to thewireless device information related to the image acquired by the camera,wherein the wireless device displays the information and the imageacquired by the camera on the display of the wireless device; andwherein a set of functions or a menu of functions are overlayed ordisplayed on top of the image acquired by the camera viewable on thedisplay used for viewing images in the wireless device, and wherein anobject represented in the image is highlighted and/or changed in colorin a virtual context.
 11. The system of claim 10, wherein a user maytouch a selected image area, wherein the wireless device executes afunction in response to the selection of the specified image area,wherein the wireless device comprises electronic wearable glasses.
 12. Awireless image recognition system comprising: a wireless device, whereinthe wireless device has a touch enabled display and a processor; adisplay area on the wireless device; wherein the wireless deviceacquires a plurality of images via a camera and performs patternrecognition using the processor on the plurality of images to create afunction, wherein the plurality of images are compressed to enableefficient communication, wherein the wireless device sends the pluralityof images to a server, wherein a set of functions or a menu of functionsare overlayed or displayed on top of an image in the display area; aserver, wherein the server receives the plurality of images from thewireless device, wherein the server performs pattern recognition of theplurality of images; and an interface on the wireless device whichinteracts with the display area through light, wherein the act ofpointing at an image on the display area launches an application on thewireless device, wherein an object represented in the image ishighlighted and/or changed in color in a virtual context.
 13. The systemof claim 12, wherein the wireless device comprises electronic wearableglasses.